-- Logs begin at Wed 2022-07-20 18:35:10 UTC, end at Wed 2022-07-20 19:44:02 UTC. -- Jul 20 19:14:54.134006 dv-cinder-819149-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:14:54.143087 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:14:54 2022] *** Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: nodename: dv-cinder-819149-14-iscsi Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: machine: x86_64 Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: clock source: unix Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: pcre jit disabled Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: detected number of CPU cores: 4 Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: current working directory: / Jul 20 19:14:54.144628 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: your processes number limit is 47680 Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: your memory page size is 4096 bytes Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: detected max file descriptor number: 2048 Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: lock engine: pthread robust mutexes Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: thunder lock: enabled Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:14:54.145379 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:14:54.189899 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: Python main interpreter initialized at 0x55a68666b9c0 Jul 20 19:14:54.189899 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: python threads support enabled Jul 20 19:14:54.189899 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: your server socket listen backlog is limited to 100 connections Jul 20 19:14:54.189899 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:14:54.190253 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:14:54.190329 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: *** Operational MODE: preforking *** Jul 20 19:14:54.190548 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:14:54.190548 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: spawned uWSGI master process (pid: 103224) Jul 20 19:14:54.195410 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: spawned uWSGI worker 1 (pid: 103225, cores: 1) Jul 20 19:14:54.195410 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: spawned uWSGI worker 2 (pid: 103226, cores: 1) Jul 20 19:14:54.195410 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:14:54.190741 dv-cinder-819149-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:14:54.849289 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:14:54.850247 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:14:55.972281 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:55.972281 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: from cryptography.utils import int_from_bytes Jul 20 19:14:55.972860 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:55.972860 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 20 19:14:55.973231 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:55.973231 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: from cryptography.utils import int_from_bytes Jul 20 19:14:55.973344 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:14:55.973344 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: from cryptography.utils import int_from_bytes Jul 20 19:14:58.457896 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:14:58.458560 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:14:58.458662 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:14:58.458662 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:14:58.459090 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:14:58.459090 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:14:58.459241 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:14:58.459319 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:14:58.459493 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:14:58.459636 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.459753 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:14:58.459964 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460111 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460301 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460471 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460631 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460796 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.460966 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461118 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461275 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461452 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461598 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461764 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.461926 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462253 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462347 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462515 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462655 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462825 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.462985 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463148 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-14-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463277 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463467 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463602 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463773 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.463909 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-14-iscsi {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464083 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464225 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464559 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464736 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.464864 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465058 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465198 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465364 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465493 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465706 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.465863 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466021 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466309 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466516 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466632 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466820 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.466914 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467127 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467247 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467451 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467543 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467771 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.467863 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468088 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468221 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468422 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468566 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468743 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.468881 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469051 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469180 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469374 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469514 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-14-iscsi {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469683 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.469812 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.470080 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.470226 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-14-iscsi {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.470389 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.470515 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.471221 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.471355 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.471537 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.471680 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.471913 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472041 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472245 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472413 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472608 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472742 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472867 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.472997 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473197 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473335 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473521 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473650 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473841 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.473972 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474178 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474319 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474444 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474569 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474749 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.474878 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475060 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475197 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475367 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475494 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475675 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475812 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.475982 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476111 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476236 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476399 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476558 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476698 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476824 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.476947 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477130 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477259 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477457 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477595 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477725 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477858 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.477984 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478110 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478284 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478415 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478549 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478682 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478861 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.478999 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479183 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479314 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479492 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479623 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479796 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.479937 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480109 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480240 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480429 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480559 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480738 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.480879 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481043 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481172 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481410 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481543 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481667 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481804 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.481951 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482081 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482264 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482403 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482582 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482804 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.482941 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483066 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483189 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483313 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483515 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483658 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483814 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.483953 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484124 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484254 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484504 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484632 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484796 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.484926 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485105 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485241 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485423 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485563 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485748 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.485877 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.486053 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.486180 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.486445 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487072 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487235 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487364 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487543 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487676 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487813 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.487939 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488070 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488196 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488399 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488549 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488721 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.488852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489025 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489152 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489330 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489467 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489639 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489768 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.489941 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490070 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490245 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490385 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490546 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490682 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490850 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.490979 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491155 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491290 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491457 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491594 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491761 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.491891 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492067 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492201 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492395 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492527 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492700 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.492920 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493063 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493194 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493318 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493446 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493598 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493726 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.493909 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494047 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494214 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494340 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494519 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494645 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494823 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.494950 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495131 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495261 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495437 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495563 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495747 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.495874 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496052 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496179 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496379 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496509 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496698 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.496826 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497003 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497129 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497309 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497436 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497619 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497746 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.497919 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498052 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498228 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498364 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498526 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498653 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498834 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.498974 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499137 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499273 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499442 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499570 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499744 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.499871 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500047 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500182 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500391 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500519 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500644 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500768 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.500951 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501159 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501305 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501432 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501556 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501680 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501825 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.501963 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502182 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502310 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502495 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502625 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502800 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.502944 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.503134 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.503260 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.503385 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.503517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.503702 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:14:58.503839 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504037 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504166 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504390 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504522 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504731 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.504868 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.505043 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.505170 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.505374 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.505512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.505686 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.508267 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.508450 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.508580 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.508580 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.510967 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.511097 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.511223 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.511223 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.513692 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.513827 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.513973 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.513973 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514212 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514336 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514460 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514584 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514733 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514868 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.514993 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515119 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515244 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515368 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515502 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515635 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515761 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.515885 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516016 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516149 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516326 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516468 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516594 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516718 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516850 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.516975 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517107 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517242 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517368 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517492 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517617 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517749 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.517892 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518017 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518142 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518274 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518403 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518530 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518655 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518785 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.518911 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519035 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519160 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519293 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519551 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519675 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519798 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.519922 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520055 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520181 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520325 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520453 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520577 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520713 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520849 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.520975 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521099 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521224 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521349 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521486 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521613 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521745 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.521878 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522004 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522127 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522250 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522375 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522500 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522624 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522748 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.522872 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523004 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523130 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523254 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523384 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523511 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523642 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523859 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.523989 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524127 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524253 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524529 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524640 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524747 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524860 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.524990 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525116 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525248 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525385 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525511 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525636 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525760 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.525884 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526021 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526147 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526272 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526396 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526520 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526645 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526788 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.526921 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527047 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527177 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527309 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527642 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527767 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.527890 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528015 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528138 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528271 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528439 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528564 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528688 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528823 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.528949 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529082 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529207 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529332 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529463 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529588 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529712 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529846 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.529971 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530095 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530218 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530351 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530485 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530619 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530747 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.530873 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531004 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531130 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531388 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531519 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531644 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531767 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.531893 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532024 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532150 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532283 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532443 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532577 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532710 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532836 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.532969 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.533095 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.533716 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.533867 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534204 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534330 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534455 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534593 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534719 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534852 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.534986 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535112 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535243 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535369 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535493 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535626 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535751 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.535885 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536010 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536136 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536274 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536422 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536547 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536672 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536796 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.536937 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537076 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537203 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537334 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537460 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537593 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537719 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537856 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.537991 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538126 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538258 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538394 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538527 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538661 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538787 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.538911 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539043 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539170 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539307 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539434 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539559 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539692 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539818 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.539942 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540076 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540201 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540365 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540493 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540618 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540750 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.540884 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541010 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541143 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541270 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541403 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541529 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541662 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541795 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.541929 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542054 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542312 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542450 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542577 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542701 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542825 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.542949 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543082 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543207 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543331 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543464 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543590 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543715 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.543978 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544177 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544456 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544593 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544729 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544855 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.544979 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545104 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545228 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545365 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545481 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545575 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545657 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545735 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545814 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545901 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.545982 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546061 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546139 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546223 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546303 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546471 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546550 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546628 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546706 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546871 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.546951 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547029 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547115 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547196 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547273 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547360 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547441 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547520 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547638 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547783 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.547972 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.548098 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.548402 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.548497 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.548723 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.548889 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.549577 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.549709 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.549888 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550017 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550193 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550329 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550497 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550628 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550801 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.550921 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551107 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551248 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551413 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551542 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551723 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.551853 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552028 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552157 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552389 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552642 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552767 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.552950 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553094 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553251 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553381 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553552 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553687 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.553857 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554002 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554233 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554370 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554504 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554629 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554778 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.554917 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555079 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555206 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555383 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555528 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555704 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.555840 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556011 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556139 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556338 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556473 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556645 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.556947 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.557075 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.557254 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.557650 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.557829 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.557968 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558139 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558266 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558454 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558582 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558764 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.558892 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559073 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559200 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559384 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559513 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559693 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559822 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.559984 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560110 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560326 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560472 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560640 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560750 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.560958 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561054 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561257 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561361 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561565 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561650 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561874 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.561967 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562183 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562276 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562496 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562582 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562807 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.562907 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563116 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563212 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563421 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563505 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563722 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.563805 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564030 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564115 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564356 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564448 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564694 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.564953 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565050 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565285 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565558 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565651 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565891 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.565985 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566207 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566293 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566521 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566605 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566838 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.566929 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567156 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567242 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567489 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567651 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567802 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.567954 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568095 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568242 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568458 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568615 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568763 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.568903 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569050 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569190 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569352 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569500 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569641 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569787 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.569927 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570065 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570212 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570352 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570498 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570639 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570785 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.570932 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571097 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571253 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571393 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571543 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571685 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571834 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.571974 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572113 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572252 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572422 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572563 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572738 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.572892 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573043 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573182 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573321 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573460 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573607 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573747 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.573887 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574025 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574171 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574310 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574542 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574694 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574839 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.574989 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575128 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575280 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575420 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575559 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575698 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575836 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.575975 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576189 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576380 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576528 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576666 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576805 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.576955 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577107 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577247 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577386 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577531 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577671 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577822 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.577964 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578108 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578254 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578393 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578530 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578686 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578827 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.578972 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579111 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579257 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579541 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579681 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579819 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.579957 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580173 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580356 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580513 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580665 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580812 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.580951 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581090 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581239 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581379 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581525 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581665 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581802 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.581940 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582086 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582226 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582364 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582512 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582650 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582788 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.582935 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583081 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583221 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583360 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583497 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583641 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583792 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.583931 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584069 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584213 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584399 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584569 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584791 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.584944 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585091 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585230 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585369 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585516 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585656 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585794 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.585933 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586072 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586210 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586372 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586650 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586789 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.586928 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587066 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587212 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587351 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587497 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587636 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587782 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.587929 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588078 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588217 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588403 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588607 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588700 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588887 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.588978 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.589206 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.589447 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.589615 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.589771 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.589913 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590067 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590206 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590345 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590484 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590632 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590773 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.590911 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591057 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591196 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591343 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591483 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591624 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591762 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.591910 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592049 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592201 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592377 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592538 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592693 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592832 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.592972 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593119 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593267 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593406 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593544 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593681 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593831 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.593983 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594123 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594400 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594539 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594686 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.594915 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.595061 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.595200 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.595348 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.595487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.595635 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.596374 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.596524 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.596664 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.596803 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.596942 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597092 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597232 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597371 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597509 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597654 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597794 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.597946 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598096 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598235 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598380 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598520 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598665 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598813 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.598954 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599092 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599258 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599405 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599644 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599790 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.599951 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600109 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600319 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600476 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600628 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600768 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.600906 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601052 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601191 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601337 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601484 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601632 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601771 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.601946 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602104 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602319 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602482 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602714 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602858 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.602997 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603137 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603285 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603425 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603571 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603712 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603851 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.603997 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.604224 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.604458 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.604603 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.604742 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.604897 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605125 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605280 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605421 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605570 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605570 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605844 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.605983 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.606146 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.606286 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.606426 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.606712 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.606873 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.607023 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.607428 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.607575 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.607745 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608057 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608201 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608382 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608683 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608840 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.608979 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.609276 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.609435 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.609598 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.609858 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.610004 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.610281 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.610457 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.610612 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.610889 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.611063 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.611209 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.611548 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.611751 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.611908 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.612730 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.612980 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.613216 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.613426 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.613646 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.613804 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614025 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614230 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614384 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614642 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614836 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.614992 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.615369 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.615538 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.615680 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.615967 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.616121 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.616403 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.616605 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.616753 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617009 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617214 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617384 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617637 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617823 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.617978 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.618254 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.618401 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.618549 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.618862 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619008 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619186 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619509 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619663 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619821 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.619973 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.620119 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.620384 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.620535 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.620750 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.620934 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.621082 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.621370 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.621523 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.621692 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.621848 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622011 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622157 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622414 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622568 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622718 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.622859 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623032 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623194 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623358 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623506 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623701 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.623842 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624007 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624157 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624341 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624489 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624638 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624791 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.624939 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625094 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625236 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625606 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625745 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.625884 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626031 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626172 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626330 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626470 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626616 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626769 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.626933 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627089 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627229 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627368 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627507 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627654 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627802 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.627942 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628128 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628338 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628505 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628660 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628808 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.628949 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629094 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629234 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629374 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629522 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629662 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629800 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.629938 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630077 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630234 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630382 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630523 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630661 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630851 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.630999 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631151 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631303 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631467 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631623 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631763 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.631900 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632081 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632412 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632565 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632706 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632845 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.632997 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633137 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633320 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633467 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633629 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633791 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.633955 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634113 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634274 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634420 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634568 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634720 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.634860 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635000 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635160 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635308 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635473 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635697 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635844 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.635990 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636139 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636325 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636476 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636628 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636778 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.636924 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637064 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637203 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637350 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637491 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637630 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637770 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.637908 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638065 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638214 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638361 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638508 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638651 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638790 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.638930 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639081 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639229 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639369 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639509 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639646 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639804 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.639946 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640112 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640260 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640433 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640586 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640735 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.640911 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641067 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641208 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641355 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641531 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641700 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.641857 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642004 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642149 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642294 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642438 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642621 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642778 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.642924 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643070 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643221 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643367 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643519 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643673 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643827 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.643973 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644126 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644280 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644463 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644608 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644753 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.644897 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645052 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645208 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645434 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645589 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645830 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.645984 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646139 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646295 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646442 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646587 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646739 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.646892 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647039 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647232 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647389 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647535 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647680 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647837 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.647995 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648142 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648324 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648479 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648635 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648793 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.648954 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649108 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649255 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649402 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649547 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649690 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.649855 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650002 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650160 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650314 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650616 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650763 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.650908 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651054 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651199 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651344 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651664 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651810 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.651956 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652108 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652264 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652443 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652748 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.652905 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653051 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653208 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653355 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653519 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653666 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653819 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.653965 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654186 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654336 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654482 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654629 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654774 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.654927 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655082 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655229 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655392 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655539 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655687 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.655858 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656083 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656236 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656444 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656592 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656738 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.656895 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657043 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657196 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657364 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657511 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657674 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657821 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.657966 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.658110 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.658778 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.658933 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659093 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659239 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659385 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659530 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659684 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.659830 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660043 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660204 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660374 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660524 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660680 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.660836 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661025 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661208 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661359 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661504 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661649 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.661876 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662038 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662185 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662330 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662477 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662629 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.662933 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663077 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663222 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663368 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663676 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663824 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.663970 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664116 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664267 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664491 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664640 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664786 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.664931 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665085 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665231 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665385 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665539 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665697 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665848 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.665994 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666232 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666232 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666527 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666673 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666826 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.666972 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667119 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667272 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667418 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667563 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667725 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.667870 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668024 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668171 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668350 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668504 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668649 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668794 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.668959 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669105 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669252 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669397 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669549 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669705 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.669859 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670007 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670152 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670298 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670442 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670595 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670742 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.670894 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671041 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671332 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671499 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671646 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671797 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.671943 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672089 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672234 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672435 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672738 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.672882 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673027 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673179 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673333 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673491 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673636 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.673811 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.674496 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.674643 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.674802 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.674949 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675101 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675247 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675393 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675547 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675700 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.675846 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676009 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676161 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676404 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676520 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676609 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676690 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676770 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676904 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.676993 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677211 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677308 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677600 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677815 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.677904 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.678121 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.678382 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.678478 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.678722 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.678817 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679024 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679113 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679334 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679428 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679641 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679728 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.679954 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680049 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680262 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680453 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680599 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680745 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.680927 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681081 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681226 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681537 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681690 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.681856 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.682003 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.682148 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.682294 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.682699 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.682857 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683005 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683155 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683309 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683609 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683763 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.683911 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684077 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684224 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684419 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684567 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684769 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.684927 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685081 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685232 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685379 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685534 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685711 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.685866 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686024 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686170 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686315 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686553 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686714 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.686861 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687014 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687170 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687318 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687473 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687621 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687766 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.687911 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688068 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688227 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688396 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688485 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688564 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688726 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.688814 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689036 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689129 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689346 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689435 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689682 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689770 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.689992 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690089 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690321 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690409 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690614 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690789 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.690921 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691017 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691231 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691327 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691546 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691646 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691887 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.691975 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692326 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692544 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692651 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692857 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.692943 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693175 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693261 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693492 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693592 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693800 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.693886 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694107 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694205 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694409 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694497 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694712 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.694799 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695020 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695114 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695336 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695434 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695642 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695728 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.695942 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696143 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696246 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696375 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696569 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696695 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.696873 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697016 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697176 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697331 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697521 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697686 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697834 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.697990 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.698150 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.698298 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.698443 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.698590 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.698735 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699034 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699187 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699333 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699478 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699644 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699805 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.699805 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700084 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700230 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700456 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700609 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700769 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.700917 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701062 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701208 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701353 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701499 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701667 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701817 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.701963 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702116 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702262 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702408 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702569 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702569 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702848 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.702994 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703139 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703298 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703445 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703609 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703757 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.703903 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704057 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704382 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704469 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704548 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704626 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704704 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704830 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.704921 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705157 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705270 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705463 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705583 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705767 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.705894 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706070 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706204 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706403 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706511 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706677 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706811 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.706982 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707123 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707284 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707457 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707622 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707770 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.707924 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708073 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708218 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708404 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708554 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708732 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.708891 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709056 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709292 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709444 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709591 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709737 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.709882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710034 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710191 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710501 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710654 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710801 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.710947 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711122 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711271 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711416 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711561 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711720 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.711868 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712022 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712169 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712339 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712503 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712665 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712821 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.712968 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713124 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713279 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713426 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713571 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713726 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.713880 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714026 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714171 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714317 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714620 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714775 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.714931 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715078 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715223 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715378 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715527 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715680 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715833 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.715980 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716132 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716309 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716474 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716621 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716773 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.716930 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.717075 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:14:58.717229 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.717376 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.717622 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.717937 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.718247 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.718557 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.718871 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.719184 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.719512 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.719836 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.720144 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.720492 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.721340 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.721688 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.722001 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.722346 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.722674 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.722989 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.723302 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.723607 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:14:58.723858 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:14:58.779559 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Registered counter for database nova_api Jul 20 19:14:58.786104 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Registered counter for database nova_api Jul 20 19:14:58.893193 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.896366 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.900167 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:58.903679 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:58.956759 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.context [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b072c1f4-5db9-429c-b0e6-4cf58b6cf08c(cell1) {{(pid=103226) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:14:58.959088 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.context [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b072c1f4-5db9-429c-b0e6-4cf58b6cf08c(cell1) {{(pid=103225) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:14:58.960786 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:58.962462 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:58.963037 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:58.963240 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:58.964630 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:58.965413 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:14:58.965553 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_concurrency.lockutils [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103226) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:58.967401 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Registered counter for database nova_cell0 Jul 20 19:14:58.967498 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:14:58.969474 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Registered counter for database nova_cell0 Jul 20 19:14:58.971856 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Registered counter for database nova_cell1 Jul 20 19:14:58.973835 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Registered counter for database nova_cell1 Jul 20 19:14:58.979352 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.980544 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.983014 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.984405 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:58.987337 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:58.988640 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:58.990852 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:58.992933 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:59.133872 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO dbcounter [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Registered counter for database nova_cell0 Jul 20 19:14:59.140498 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO dbcounter [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Registered counter for database nova_cell0 Jul 20 19:14:59.142502 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG oslo_db.sqlalchemy.engines [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:59.147701 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writer thread running {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:59.149745 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:14:59.154135 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writer thread running {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:14:59.487711 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:59.491934 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:59.495055 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:59.499191 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:59.832879 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:59.838880 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: WARNING keystonemiddleware.auth_token [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:59.838999 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:14:59.844074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a68666b9c0 pid: 103225 (default app) Jul 20 19:14:59.844888 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: WARNING keystonemiddleware.auth_token [None req-0053abd7-a30f-4205-a5c2-a08553f2f24e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:14:59.846399 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:14:59.847629 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001910 Jul 20 19:14:59.848029 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Wed Jul 20 19:14:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:14:59.850315 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a68666b9c0 pid: 103226 (default app) Jul 20 19:16:15.527845 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:15.528925 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 20 19:16:15.529306 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:15.541227 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.542563 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell0:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.543663 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell1:SELECT=3 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:15.544757 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:16.424271 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-ee07763e-ab79-4529-b1d0-1dfeda747646 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:16.456791 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-ee07763e-ab79-4529-b1d0-1dfeda747646 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920631 Jul 20 19:16:16.460204 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 19:16:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:18.710356 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:18.711399 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d6b662b2-3a88-4c85-9b19-05f131cecec7 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 20 19:16:18.711782 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:19.163649 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-ce0f91d1-95e3-400c-8974-1669d0542bcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "ram": 256}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:19.182776 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:16:19.182776 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: warnings.warn(msg) Jul 20 19:16:19.212783 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-ce0f91d1-95e3-400c-8974-1669d0542bcb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494820 Jul 20 19:16:19.213455 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:19.227462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.228917 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.229753 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=3 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.230578 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:19.452569 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ce021148-5083-4985-aca8-8698e8ad553c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:19.455162 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:16:19.455162 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:16:19.523078 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ce021148-5083-4985-aca8-8698e8ad553c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301191 Jul 20 19:16:19.523799 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:21.806251 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-ce0f91d1-95e3-400c-8974-1669d0542bcb admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:21.807330 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-ce0f91d1-95e3-400c-8974-1669d0542bcb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 20 19:16:21.808198 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:22.498896 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b8948329-8783-4c23-b632-77b4eb41830b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "id": "d1"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:22.519574 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:16:22.519574 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:16:22.539232 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b8948329-8783-4c23-b632-77b4eb41830b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.724889 Jul 20 19:16:22.540541 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:22.552503 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-01861524-5264-4506-bff7-d4f5e78b4a6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:22.554092 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:16:22.554092 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: warnings.warn(msg) Jul 20 19:16:22.589052 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-01861524-5264-4506-bff7-d4f5e78b4a6c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039745 Jul 20 19:16:22.590260 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:24.941866 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b8948329-8783-4c23-b632-77b4eb41830b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:24.943728 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b8948329-8783-4c23-b632-77b4eb41830b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002342 Jul 20 19:16:24.944819 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:16:25.345579 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-3cc32f91-765c-4944-aa37-1e7829d5cde1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 1024}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:25.364026 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-3cc32f91-765c-4944-aa37-1e7829d5cde1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413113 Jul 20 19:16:25.364579 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:25.376538 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-5e4d4b63-3984-46de-91b4-f6cc76a06e7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:25.398976 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-5e4d4b63-3984-46de-91b4-f6cc76a06e7b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026475 Jul 20 19:16:25.399595 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:27.604752 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-3cc32f91-765c-4944-aa37-1e7829d5cde1 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:27.605772 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-3cc32f91-765c-4944-aa37-1e7829d5cde1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 20 19:16:27.606173 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:28.045082 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-61ef96fd-b0df-4d88-9783-62e16aaec587 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "name": "ds2G", "vcpus": 2, "ram": 2048}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:28.065274 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-61ef96fd-b0df-4d88-9783-62e16aaec587 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452502 Jul 20 19:16:28.065851 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:28.080466 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-0d55bfd9-1048-4797-b25f-8a3e75fab77e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:28.103493 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-0d55bfd9-1048-4797-b25f-8a3e75fab77e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029260 Jul 20 19:16:28.104980 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:30.411652 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-61ef96fd-b0df-4d88-9783-62e16aaec587 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:30.412798 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-61ef96fd-b0df-4d88-9783-62e16aaec587 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 20 19:16:30.413199 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:30.841522 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:30.860281 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441131 Jul 20 19:16:30.861210 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:30.872728 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-bf64925e-746b-41fc-b0a4-60836189cc26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:30.897265 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-bf64925e-746b-41fc-b0a4-60836189cc26 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028079 Jul 20 19:16:30.897764 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jul 20 19:16:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:33.180652 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:33.182479 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002559 Jul 20 19:16:33.183376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:33.625560 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-80d1ac04-47c4-462f-a9c4-fcdbf67f22b6 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:33.650361 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-80d1ac04-47c4-462f-a9c4-fcdbf67f22b6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458857 Jul 20 19:16:33.650938 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 19:16:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:16:35.976136 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:35.977181 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-5017666a-561c-47be-9ab0-dc6041a03441 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 20 19:16:35.977583 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:36.401631 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-174725db-cf5b-435f-8ab1-85f2f724de3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:36.419757 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-174725db-cf5b-435f-8ab1-85f2f724de3d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.435956 Jul 20 19:16:36.420342 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:36.432723 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-789e36da-25da-4879-b8b3-592954c54bc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:36.456153 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-789e36da-25da-4879-b8b3-592954c54bc0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027131 Jul 20 19:16:36.456799 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:38.659074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-174725db-cf5b-435f-8ab1-85f2f724de3d admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:38.660090 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-174725db-cf5b-435f-8ab1-85f2f724de3d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 20 19:16:38.660527 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:39.051232 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-80f3c781-f807-4237-8c19-e04ebc78607b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "id": "2", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:39.069993 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-80f3c781-f807-4237-8c19-e04ebc78607b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.403601 Jul 20 19:16:39.070554 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:39.082620 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a9d64a99-3cab-41b8-baaf-67e504b07c76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:39.106105 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a9d64a99-3cab-41b8-baaf-67e504b07c76 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027339 Jul 20 19:16:39.106681 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:16:41.383273 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-80f3c781-f807-4237-8c19-e04ebc78607b admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:41.384245 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-80f3c781-f807-4237-8c19-e04ebc78607b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Jul 20 19:16:41.384767 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:41.814458 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a8f6e6d7-f543-4420-90ce-130639e100f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "3", "name": "m1.medium", "disk": 40}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:41.832923 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a8f6e6d7-f543-4420-90ce-130639e100f6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441704 Jul 20 19:16:41.833477 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:16:41.845783 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-547b8b00-dece-4dda-8730-dccaefd9c1b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:41.868318 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-547b8b00-dece-4dda-8730-dccaefd9c1b9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026656 Jul 20 19:16:41.868916 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:44.099937 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-a8f6e6d7-f543-4420-90ce-130639e100f6 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:44.100997 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-a8f6e6d7-f543-4420-90ce-130639e100f6 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 20 19:16:44.101407 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:44.538143 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-6d2c6fb0-2f0f-4fde-a633-b1c779a68182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "name": "m1.large", "id": "4"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:44.559657 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-6d2c6fb0-2f0f-4fde-a633-b1c779a68182 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452555 Jul 20 19:16:44.560209 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:44.572034 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-32399d7b-daea-4aab-9964-2675d9487345 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:44.596046 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-32399d7b-daea-4aab-9964-2675d9487345 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027618 Jul 20 19:16:44.606811 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:16:46.875414 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-6d2c6fb0-2f0f-4fde-a633-b1c779a68182 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:16:46.877030 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-6d2c6fb0-2f0f-4fde-a633-b1c779a68182 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Jul 20 19:16:46.877961 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:16:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:16:47.307732 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "disk": 160}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:47.332552 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.448732 Jul 20 19:16:47.333445 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jul 20 19:16:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:16:47.351496 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-558a769f-8c30-43e3-bf05-99e074491449 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:16:47.355008 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:47.377218 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-558a769f-8c30-43e3-bf05-99e074491449 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033593 Jul 20 19:16:47.377826 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jul 20 19:16:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:17:07.762006 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:07.762992 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Jul 20 19:17:07.763388 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:17:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:17:08.160837 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-ecbfd4c0-482e-453f-b5e4-7f51d56a0f09 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:08.178912 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-ecbfd4c0-482e-453f-b5e4-7f51d56a0f09 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409389 Jul 20 19:17:08.179377 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 19:17:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:17:09.249477 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:09.250499 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-0fbf95bd-c592-41e3-a996-28383b2772d4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 20 19:17:09.251474 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:09.771644 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-d2af4a89-53bf-4b16-81a1-61f9cd3c3cf0 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:09.777362 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-d2af4a89-53bf-4b16-81a1-61f9cd3c3cf0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-d2af4a89-53bf-4b16-81a1-61f9cd3c3cf0 admin admin] Request method failure captured: Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept: application/json Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Connection: keep-alive Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Content-Length: 0 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Host: 10.222.0.43 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABi2FS1LBQG5V-nRXNKRiJy4vonmreL771RTOl6_teHzlitr8uUV47sbuEovPOV0r2fswWJg-ccEA1Oq5Lk4NgM6JlGqgYi6QNDHVHfPcQQMpGbqchtx92mOv7QbiaSmsuBNjYtqL4ePato3DI_vTyLdrtKEfz3RFzDDZ2zAB3YafozAu0 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Id: None Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Name: None Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Name: admin Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Role: reader,member,admin Jul 20 19:17:09.780599 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Roles: reader,member,admin Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant: admin Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User: admin Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Name: admin Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: method: > Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: exception: Flavor 42 could not be found. Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: action_args: {'id': '42'} Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:09.782777 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:09.783852 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.785238 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-d2af4a89-53bf-4b16-81a1-61f9cd3c3cf0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:09.786579 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-d2af4a89-53bf-4b16-81a1-61f9cd3c3cf0 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394771 Jul 20 19:17:09.786579 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 19:17:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:09.792123 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-4e6f5ce3-ae7c-4d70-b0f1-228563068be3 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:09.795092 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:09.815485 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-4e6f5ce3-ae7c-4d70-b0f1-228563068be3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026941 Jul 20 19:17:09.816066 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:09.825728 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-9fa53084-4197-4b58-b4f1-afa0d2c2f55b admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:09.847126 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-9fa53084-4197-4b58-b4f1-afa0d2c2f55b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024881 Jul 20 19:17:09.847661 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:09.857558 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d28b81d3-fbab-4578-8769-b3e6f34f7ac1 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:09.863667 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-d28b81d3-fbab-4578-8769-b3e6f34f7ac1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d28b81d3-fbab-4578-8769-b3e6f34f7ac1 admin admin] Request method failure captured: Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Host: 10.222.0.43 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2FS1LBQG5V-nRXNKRiJy4vonmreL771RTOl6_teHzlitr8uUV47sbuEovPOV0r2fswWJg-ccEA1Oq5Lk4NgM6JlGqgYi6QNDHVHfPcQQMpGbqchtx92mOv7QbiaSmsuBNjYtqL4ePato3DI_vTyLdrtKEfz3RFzDDZ2zAB3YafozAu0 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Role: reader,member,admin Jul 20 19:17:09.866882 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Roles: reader,member,admin Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User: admin Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: method: > Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: exception: Flavor 42 could not be found. Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: action_args: {'id': '42'} Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:09.868426 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:09.869206 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:09.870327 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d28b81d3-fbab-4578-8769-b3e6f34f7ac1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:09.871610 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d28b81d3-fbab-4578-8769-b3e6f34f7ac1 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014834 Jul 20 19:17:09.871610 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 19:17:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 19:17:10.852808 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-9fa53084-4197-4b58-b4f1-afa0d2c2f55b admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:10.853921 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-9fa53084-4197-4b58-b4f1-afa0d2c2f55b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 20 19:17:10.854388 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:11.400251 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-6656dc5c-79de-48f3-9239-980e300e743b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:11.406616 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-6656dc5c-79de-48f3-9239-980e300e743b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-6656dc5c-79de-48f3-9239-980e300e743b admin admin] Request method failure captured: Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Host: 10.222.0.43 Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2FS2F-mjaNnjDAX5-fknxvZ2WZ5U37Mho5mrqS5uVDvNEiBY_jZ-YZlwcEceEocFGnxT2_iZVxiFVCLjDyq1AOlWkGbl4p-eAxGwWAtLA4P1_-8SeLstVPlTXlXS6RGX6v9d71tDaa5xeUD_-AB5QqPeev6UEk5ZnrCOUCdeZmOMr-Y Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Role: reader,member,admin Jul 20 19:17:11.409074 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Roles: reader,member,admin Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User: admin Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: method: > Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: exception: Flavor 84 could not be found. Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: action_args: {'id': '84'} Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:11.410429 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:11.412395 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.413480 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-6656dc5c-79de-48f3-9239-980e300e743b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:11.414517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-6656dc5c-79de-48f3-9239-980e300e743b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.415312 Jul 20 19:17:11.414517 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 19:17:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:11.420282 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-19ee6a59-aad0-438d-b67d-898b9f2a587d admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:11.435108 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-19ee6a59-aad0-438d-b67d-898b9f2a587d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018322 Jul 20 19:17:11.435666 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:11.445493 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-49604d47-4571-402b-a7a1-3f19c1c251d8 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:11.459420 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-49604d47-4571-402b-a7a1-3f19c1c251d8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017527 Jul 20 19:17:11.459987 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:11.470504 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-10b07fda-ebe2-431a-ba19-06237950c163 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:11.476034 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-10b07fda-ebe2-431a-ba19-06237950c163 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-10b07fda-ebe2-431a-ba19-06237950c163 admin admin] Request method failure captured: Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept: application/json Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Connection: keep-alive Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Content-Length: 0 Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Host: 10.222.0.43 Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABi2FS2F-mjaNnjDAX5-fknxvZ2WZ5U37Mho5mrqS5uVDvNEiBY_jZ-YZlwcEceEocFGnxT2_iZVxiFVCLjDyq1AOlWkGbl4p-eAxGwWAtLA4P1_-8SeLstVPlTXlXS6RGX6v9d71tDaa5xeUD_-AB5QqPeev6UEk5ZnrCOUCdeZmOMr-Y Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Id: None Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Name: None Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Name: admin Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Role: reader,member,admin Jul 20 19:17:11.477601 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Roles: reader,member,admin Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant: admin Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User: admin Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Name: admin Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: method: > Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: exception: Flavor 84 could not be found. Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: action_args: {'id': '84'} Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:11.479475 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:11.480262 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:11.481376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-10b07fda-ebe2-431a-ba19-06237950c163 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:11.482497 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-10b07fda-ebe2-431a-ba19-06237950c163 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012649 Jul 20 19:17:11.482497 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jul 20 19:17:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:12.463987 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-49604d47-4571-402b-a7a1-3f19c1c251d8 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:12.465043 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-49604d47-4571-402b-a7a1-3f19c1c251d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 20 19:17:12.465440 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:13.002189 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-951ec060-8919-4516-9361-12aade646f60 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:13.008070 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.wsgi [None req-951ec060-8919-4516-9361-12aade646f60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-951ec060-8919-4516-9361-12aade646f60 admin admin] Request method failure captured: Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept: application/json Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Accept-Encoding: gzip, deflate Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Connection: keep-alive Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Content-Length: 0 Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Host: 10.222.0.43 Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Openstack-System-Scope: None Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: User-Agent: python-novaclient Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Auth-Token: gAAAAABi2FS4VXPvT5ozz5mT7wGregD8I64SlLm7z8jP7kfzEkp86QP5CR-NCB8zrbf4bAJoeq3Qh2DsqyJAQpG8iuJ5LmZ4qma6xsnFnGsmusMIOBuA1EbIbL7pbtdpT3LpB00FWC6QTGEqBb-5mTBcQrltNDi0wijT7ycrycW9IHQaI9hnrCg Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Id: None Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Domain-Name: None Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Identity-Status: Confirmed Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Is-Admin-Project: True Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Id: default Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Domain-Name: Default Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Project-Name: admin Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Role: reader,member,admin Jul 20 19:17:13.009591 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Roles: reader,member,admin Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant: admin Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-Tenant-Name: admin Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User: admin Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Id: default Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Domain-Name: Default Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: X-User-Name: admin Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: method: > Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: exception: Flavor 451 could not be found. Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: action_args: {'id': '451'} Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:13.011487 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:13.012346 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.013784 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-951ec060-8919-4516-9361-12aade646f60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103226) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:13.015091 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-951ec060-8919-4516-9361-12aade646f60 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.407666 Jul 20 19:17:13.015091 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:17:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:13.021151 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-d00fe1d0-28d8-4861-abe9-f33b0d5f1796 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:13.035193 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-d00fe1d0-28d8-4861-abe9-f33b0d5f1796 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017584 Jul 20 19:17:13.035914 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:13.046024 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:13.061807 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019669 Jul 20 19:17:13.062354 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jul 20 19:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:17:13.072413 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-59da14da-73f4-444c-ae95-067644171d3b admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:13.077870 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.wsgi [None req-59da14da-73f4-444c-ae95-067644171d3b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-59da14da-73f4-444c-ae95-067644171d3b admin admin] Request method failure captured: Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept: application/json Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Accept-Encoding: gzip, deflate Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Connection: keep-alive Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Content-Length: 0 Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Host: 10.222.0.43 Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-Api-Version: compute 2.90 Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Openstack-System-Scope: None Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: User-Agent: python-novaclient Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Auth-Token: gAAAAABi2FS4VXPvT5ozz5mT7wGregD8I64SlLm7z8jP7kfzEkp86QP5CR-NCB8zrbf4bAJoeq3Qh2DsqyJAQpG8iuJ5LmZ4qma6xsnFnGsmusMIOBuA1EbIbL7pbtdpT3LpB00FWC6QTGEqBb-5mTBcQrltNDi0wijT7ycrycW9IHQaI9hnrCg Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Id: None Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Domain-Name: None Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Identity-Status: Confirmed Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Is-Admin-Project: True Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Id: default Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Domain-Name: Default Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Project-Name: admin Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Role: reader,member,admin Jul 20 19:17:13.079390 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Roles: reader,member,admin Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/39f878600fda47389da52621d6e0947c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_39f878600fda47389da52621d6e0947c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/39f878600fda47389da52621d6e0947c"}]}] Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant: admin Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Id: 39f878600fda47389da52621d6e0947c Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-Tenant-Name: admin Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User: admin Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Id: default Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Domain-Name: Default Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Id: 44b032994ab44ba0acf66376eaab2451 Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: X-User-Name: admin Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: method: > Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: exception: Flavor 451 could not be found. Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: action_args: {'id': '451'} Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:17:13.080948 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:13.081916 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: ERROR nova.api.openstack.wsgi Jul 20 19:17:13.083186 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-59da14da-73f4-444c-ae95-067644171d3b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103225) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:17:13.084534 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-59da14da-73f4-444c-ae95-067644171d3b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011964 Jul 20 19:17:13.084534 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:17:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:14.105422 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:14.106420 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 20 19:17:14.106801 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:14.640795 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-652b5f2c-8e68-40ae-9d0b-20c02e009d69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:17:14.660048 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-652b5f2c-8e68-40ae-9d0b-20c02e009d69 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.415571 Jul 20 19:17:14.660614 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 19:17:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:17:15.631968 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:15.633016 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 20 19:17:15.633403 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:16.155546 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-96a8aefb-b15e-453f-9b53-a40e3d31a42d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:17:16.174000 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-96a8aefb-b15e-453f-9b53-a40e3d31a42d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403678 Jul 20 19:17:16.174533 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 19:17:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:17:17.150883 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:17.152006 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 20 19:17:17.152419 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:17.680481 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-9d16ed3d-299b-4744-8d42-e5fa2cda3cd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:17:17.697741 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-9d16ed3d-299b-4744-8d42-e5fa2cda3cd2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405430 Jul 20 19:17:17.698290 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 19:17:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:18.669252 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:18.670296 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 20 19:17:18.670692 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:17:19.206763 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-cfb1cdef-d1a0-48d0-a29c-14e5a75dc1d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:17:19.224966 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-cfb1cdef-d1a0-48d0-a29c-14e5a75dc1d1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.412945 Jul 20 19:17:19.225507 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jul 20 19:17:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:17:20.221644 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:20.222258 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 19:17:20.222258 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:17:20.775933 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-3fb500c4-82a1-49b8-9c0e-5fea0e35fcd5 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:17:20.795807 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-3fb500c4-82a1-49b8-9c0e-5fea0e35fcd5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.431515 Jul 20 19:17:20.796369 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Wed Jul 20 19:17:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:18:12.598939 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:12.599942 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-4c54744c-e36b-44ff-8193-63f7dad65963 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 20 19:18:12.600391 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jul 20 19:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:18:12.611518 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:12.992873 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-433b3ccf-6569-49b5-87a9-eca7da898532 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:13.011532 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-433b3ccf-6569-49b5-87a9-eca7da898532 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405406 Jul 20 19:18:13.012067 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jul 20 19:18:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:18:13.036216 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-012c9add-772d-419a-ac0d-218388f0e8bf admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:13.039624 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG dbcounter [-] [103226] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103226) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:13.045296 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-012c9add-772d-419a-ac0d-218388f0e8bf admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013283 Jul 20 19:18:13.045822 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jul 20 19:18:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:18:13.058410 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-77363111-c48a-4eef-963d-35a9785f4279 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:13.066937 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-77363111-c48a-4eef-963d-35a9785f4279 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012121 Jul 20 19:18:13.067462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jul 20 19:18:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:18:13.080939 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:13.089269 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013596 Jul 20 19:18:13.089807 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jul 20 19:18:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:18:13.102071 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-884653c0-b48c-460f-809a-fa04d29da325 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:18:13.110645 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-884653c0-b48c-460f-809a-fa04d29da325 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012144 Jul 20 19:18:13.111443 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jul 20 19:18:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:21:39.740074 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:39.741144 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 20 19:21:39.741534 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:39.878647 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=6 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:40.036242 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:40.037419 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:40.037419 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:21:40.038612 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:40.039055 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:40.039836 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:40.040264 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:40.074136 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-3badfb1c-10fc-4e36-9c58-95f6279d87c4 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.196994 Jul 20 19:21:40.074684 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:40.895556 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:40.897939 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002438 Jul 20 19:21:40.898357 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:41.088839 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:41.090000 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:41.090000 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:21:41.091199 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:41.091636 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:41.092463 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:41.092938 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:41.111971 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-22a4b5ce-7406-473e-87b4-d6dc14e24451 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075219 Jul 20 19:21:41.112462 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:41 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:21:52.346740 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:52.347744 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 20 19:21:52.349020 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:52.493356 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell0:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:52.494098 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_cell1:SELECT=4 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:52.494702 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG dbcounter [-] [103225] Writing DB stats nova_api:SELECT=8 {{(pid=103225) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:21:52.543410 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:52.544633 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:52.544633 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:21:52.545809 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:52.546242 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:52.547012 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:52.547438 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:52.573527 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-b9ea8d66-828a-457d-825a-7e363584ce71 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084549 Jul 20 19:21:52.574076 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:21:53.399905 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: DEBUG nova.api.openstack.wsgi [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] Calling method '>' {{(pid=103226) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:53.400950 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: INFO nova.api.openstack.requestlog [None req-82fe85d5-5dff-4bef-befc-7c5d24488fa8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 20 19:21:53.401376 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: [pid: 103226|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jul 20 19:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:21:53.596177 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG nova.api.openstack.wsgi [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] Calling method '>' {{(pid=103225) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:21:53.597407 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:21:53.597407 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: warnings.warn(msg) Jul 20 19:21:53.599284 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:53.599728 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:53.600571 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:21:53.601003 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: DEBUG oslo_concurrency.lockutils [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103225) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:21:53.623298 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: INFO nova.api.openstack.requestlog [None req-ad2c0aff-6a68-4fb4-a9d0-871c40de4da3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081577 Jul 20 19:21:53.623877 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: [pid: 103225|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jul 20 19:21:53 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:22:55.450018 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: Wed Jul 20 19:22:55 2022 - graceful shutdown triggered... Jul 20 19:22:55.450585 dv-cinder-819149-14-iscsi devstack@n-api.service[103225]: Gracefully killing worker 1 (pid: 103225)... Jul 20 19:22:55.451900 dv-cinder-819149-14-iscsi devstack@n-api.service[103226]: Gracefully killing worker 2 (pid: 103226)... Jul 20 19:22:55.452633 dv-cinder-819149-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 19:22:56.450276 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: worker 1 buried after 1 seconds Jul 20 19:22:56.450792 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: worker 2 buried after 1 seconds Jul 20 19:22:56.450792 dv-cinder-819149-14-iscsi devstack@n-api.service[103224]: goodbye to uWSGI. Jul 20 19:22:56.451828 dv-cinder-819149-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 19:22:56.452412 dv-cinder-819149-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 19:22:56.455207 dv-cinder-819149-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 19:22:56.465073 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:22:56 2022] *** Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: nodename: dv-cinder-819149-14-iscsi Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: machine: x86_64 Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: clock source: unix Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: pcre jit disabled Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: detected number of CPU cores: 4 Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: current working directory: / Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:22:56.467013 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: your processes number limit is 47680 Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: your memory page size is 4096 bytes Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: detected max file descriptor number: 2048 Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: lock engine: pthread robust mutexes Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: thunder lock: enabled Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 19:22:56.467838 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:22:56.513230 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: Python main interpreter initialized at 0x55fe015179c0 Jul 20 19:22:56.513230 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: python threads support enabled Jul 20 19:22:56.513230 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: your server socket listen backlog is limited to 100 connections Jul 20 19:22:56.513230 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:22:56.513696 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:22:56.513696 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: *** Operational MODE: preforking *** Jul 20 19:22:56.513948 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:22:56.513948 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: spawned uWSGI master process (pid: 117748) Jul 20 19:22:56.514158 dv-cinder-819149-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 19:22:56.515533 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 1 (pid: 117768, cores: 1) Jul 20 19:22:56.515533 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 2 (pid: 117769, cores: 1) Jul 20 19:22:56.515533 dv-cinder-819149-14-iscsi devstack@n-api.service[117748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:22:57.169442 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:22:57.179926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 19:22:58.368534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:58.368534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: from cryptography.utils import int_from_bytes Jul 20 19:22:58.369163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:58.369163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: from cryptography.utils import int_from_bytes Jul 20 19:22:58.402736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:58.402736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: from cryptography.utils import int_from_bytes Jul 20 19:22:58.403318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:22:58.403318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: from cryptography.utils import int_from_bytes Jul 20 19:23:00.695482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:23:00.695985 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:23:00.696174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:23:00.696560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:23:00.696817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:23:00.697205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.697549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.697859 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.698176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.698507 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.698820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.699142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.699465 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.699794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.700056 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.700403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.700730 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-14-iscsi {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.701052 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.701362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.701677 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.701998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.702307 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.702628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.702935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.703431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.703886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.704197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.704538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.704887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.705180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.705513 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.705817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.706127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.706451 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.706760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.707164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-14-iscsi {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.707480 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.707794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.708186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.709095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.709405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.709717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.710039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.710373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.710696 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.711008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.711327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.711648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.711964 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.712267 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.712601 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.712924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.713234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.713538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.713843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.714093 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.714402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.714723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.715047 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.715369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.715625 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.715874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.716193 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.716636 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.716949 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.717263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.717588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.717896 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.718205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.718513 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.718825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.719151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.721598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.723751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.724338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.724338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.725380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.725380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.725380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.725581 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.725812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.726033 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.726355 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.726665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.726973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.727282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.727584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.727893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.728206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.728552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.728860 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.729164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.729471 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.729778 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.730083 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.730389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.730707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.731028 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.731334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.731638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.731944 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.732252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.732597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.732904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.733214 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.733534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.733840 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.734145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.734462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.734769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.735077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.735395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.735698 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.736008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.736342 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.736654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.736960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.737264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.737569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.737872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.738176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.738479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.738785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.739086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.739446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.739773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.740079 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.740411 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.740717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.741050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.741375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.741706 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.742050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.742365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.742700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.743030 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.743350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.743664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.743980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.744325 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.744644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.744956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.745285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.745593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.745913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.746243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.746560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.746879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.747199 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.747512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.747836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.748179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.748529 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.748844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.749230 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.749524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.749838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.750177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.750503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.750815 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.751127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.751439 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.751761 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.752096 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.752436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.752761 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.753078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.756922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.757067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.757335 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.757616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.757923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.758228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.758540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.758846 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.759168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.759496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.759804 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.760138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.760478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.760785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.761097 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.761409 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.761716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.762029 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.762342 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.762648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.762969 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.763282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.763593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.763917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.764223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.764777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.764961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.765231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.765548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.765811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:23:00.766297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.766392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:23:00.766466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.766466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.766601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:23:00.766805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.766965 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:23:00.767119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.767277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:23:00.767422 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.767566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.767719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.767873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.768043 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.768196 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.768378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.768559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.768723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.768878 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.769022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.769166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.769310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.769476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.769630 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.769776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.769985 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.770155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.770301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.770461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.771246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.771400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.771567 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.771720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-14-iscsi {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.771865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.772090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.772245 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.772453 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.772601 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.772764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.772920 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.773076 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.773221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.773372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.773517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.773683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.773838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.774004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.774156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.774156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.774938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.775179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.775357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.775512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.775666 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.775847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.776000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.776184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.777105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.777278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.777427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.777573 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.777718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.777887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.778042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.778195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.778341 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.778492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.778645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.778803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.778957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.779102 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.779253 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-14-iscsi {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.779399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.779551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.779704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.779859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.780003 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.780155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.780345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.780509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.780662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.780814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.780958 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.781101 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.781256 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.781402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.781558 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.781712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.781865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.782026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.782192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.782380 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.782543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.782698 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.782843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.782996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.783151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.783305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.783466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.783625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.783788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.783934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.784088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.784241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.784429 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.785084 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.785240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.785398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.785557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.785705 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.785863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.786021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.786173 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.786337 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.786493 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.786735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.786893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.787039 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.787184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.787328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.787328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.787634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.787795 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.787951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.788104 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.788278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.788526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.788681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.788827 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.788971 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.789123 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.789282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.789435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.789588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.789733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.789878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.790022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.790190 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.790337 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.790489 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.790642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.790788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.790941 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.791099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.791244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.791395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.791548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.791700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.791854 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.792007 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.792178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.792367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.792529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.792674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.792832 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.792979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.793131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.793284 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.793429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.793580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.793734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.793887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.794040 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.794196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.794348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.794501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.794673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.795296 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.795451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.795604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.795749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.795915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.796073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.796378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.796567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.796760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.796973 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.797138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.797284 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.797430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.797574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.797725 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.797870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.798027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.798181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.798327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.798479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.798623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.798786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.798941 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.799086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.799231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.799381 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.799532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.799685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.799830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.799974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.800124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.800277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.800459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.800685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.800843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.800996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.801141 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.801292 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.801438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.801595 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.801741 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.801893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.802037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.802190 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.802343 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.802499 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.802499 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.802789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.802933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.803104 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.803104 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.803873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.803873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.804163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.804339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.804492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.804653 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.804798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.805489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.805661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.805827 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.805991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.805991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.806268 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.806420 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.806575 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.806727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.806872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.807109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.807260 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.807405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.807560 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.807719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.807872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.808033 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.808187 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.808359 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.808359 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.808659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.808812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.808957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.809100 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.809100 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.809392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.809537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.809759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.810001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.810001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.810467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.810634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.810634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.811183 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.811359 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.811514 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.811668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.811668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.811952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.812111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.812269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.812452 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.812598 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.812767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.813008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.813259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.813259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.813573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.813720 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.813872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.814025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.814025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.814312 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.814477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.814629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.814774 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.814774 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.815741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.815909 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.816069 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.816215 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.816445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.816607 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.816753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.816898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.817082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:23:00.817326 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.817970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818128 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818427 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818572 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.818868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819326 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819471 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819782 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.819934 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820724 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.820869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.821924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822358 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.822955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823107 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823428 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.823943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824253 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824758 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.824904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.825048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.825224 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.825838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826089 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826249 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.826996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.827991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.828782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829064 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829363 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.829960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.830105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.830259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.830429 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.830703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.830863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831009 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.831986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832325 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.832947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.833752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834066 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834390 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.834854 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.835013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.835157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.835302 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.835454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836508 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.836954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837256 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837401 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.837925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838691 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.838994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.839159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.839416 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.839567 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.839723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.839869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840027 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.840951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841108 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841706 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.841861 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842455 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.842920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.843980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.844972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.845125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.845431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.845645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.846502 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.846722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.846912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.847130 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.847339 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.847543 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.847740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.847929 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.848116 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.848340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.848533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.848718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.848880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849034 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849526 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.849999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850302 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850779 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.850957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.851195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.851360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.851523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.851692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.851852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.852895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.853987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854312 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854473 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.854960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.855267 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.855430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.855582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.855741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.855920 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.856577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.856833 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857295 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857454 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.857942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.858102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.858273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.858425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.858577 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.858742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859317 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859627 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859826 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.859981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860645 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.860966 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861127 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861364 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.861998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862791 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.862943 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.863094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.863246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.863405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.863595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.863839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.864077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.864575 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.864734 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.864886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865068 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865376 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.865845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.866004 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.866188 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.866766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.866921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.866921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.867443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.867443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.867760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.867760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868049 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868623 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868783 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.868936 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869560 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.869890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870043 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870518 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.870981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.871142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.871301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.871556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.871723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.871889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872407 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872572 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872736 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.872889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873047 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873214 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873688 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.873840 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874175 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874335 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874488 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874810 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.874972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875750 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.875992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.876165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.876352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.877109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.877535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.877738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.877946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.878144 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.878341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.878531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.878726 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.878924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.879122 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.879392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.879694 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.880515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.880771 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.881033 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.881279 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.881548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.881919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.882176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.883269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.883447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.883604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.883766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.883941 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.884095 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.884249 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.884484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.884647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.884806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.885497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.885669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.885839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.885993 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.886145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.886298 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.886457 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.886650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.887219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.887391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.887742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.887908 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888565 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.888869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.889205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.889375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.889553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.889708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.889868 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890504 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.890980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.891143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.891305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.891305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.891622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.892605 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.892768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.892937 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893409 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.893876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894029 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894352 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.894851 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.895109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.895298 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.895467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.895683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.896360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.896537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.896770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.897258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.897524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.897707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898039 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898354 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.898985 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899289 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899626 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.899954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.900934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901085 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901236 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901555 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.901878 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902358 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.902927 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.903859 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904182 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.904870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905189 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905655 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.905970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906296 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.906934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.907394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.907649 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.907809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.908143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.908348 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.908606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.908854 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.909113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.909367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.909613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.909870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.910128 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.910369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.910627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.910880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.911111 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.911389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.911674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.911924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.912174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.912459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.912818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.913081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.913339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.913604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.913862 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.914112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.914359 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.914729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.914991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.915261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.915528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.915800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.916056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.916414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.916680 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.916934 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.917785 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.917974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.918333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.918497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.918660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.918830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.918984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919147 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919301 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919783 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.919946 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920779 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.920943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921104 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.921891 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.922044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.922203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.922408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.922568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.922727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923324 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.923800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.924991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925317 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.925959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.926905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.927058 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.927222 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.927382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.927926 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.928107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.928280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.928663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.928829 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.928991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929323 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929484 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.929960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930122 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930439 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.930904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931235 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931391 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.931887 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932404 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.932890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933292 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.933930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934585 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934746 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.934912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935393 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935546 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935712 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.935864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.936974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.937262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.937415 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.937567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.937567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.938261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.938417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.938417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.938892 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939065 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939688 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939841 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.939999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.940237 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.940429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.940583 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.940743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.940905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941076 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941239 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941705 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.941859 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.942010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.942175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.942334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943268 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943775 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943929 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.943929 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.944230 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.944408 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.944574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.944727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.944879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.945031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.945202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.945202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.945717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.945925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.946137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.946327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.946567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.946769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.946972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.947186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.947345 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.947497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.947649 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.947819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.948376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.948541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.948881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949520 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.949996 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950324 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.950960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.951923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952085 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952750 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.952914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.953075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.953255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.953480 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.953647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.954514 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.954676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.954839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.954994 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955161 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955486 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.955953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.956973 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957302 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957455 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.957947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.959476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.959660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.959815 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.959969 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960787 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.960947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961117 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.961907 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962060 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962543 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.962864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963353 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963533 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.963986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.964141 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.964327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.964498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.964652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.964901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.965863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966189 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.966892 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.967060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.967228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.967388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.967554 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.967997 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.968164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.968438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.968620 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.968789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.969843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970230 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970390 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970571 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.970887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.971840 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972153 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972337 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.972801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.973025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.973197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.973362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.973524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.973717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974712 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.974872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975435 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975756 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.975756 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.976062 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.976221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.976460 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.976625 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.976909 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977211 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977734 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.977855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978160 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978322 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.978898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.979034 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980235 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980732 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.980873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981765 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.981913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982741 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.982881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983136 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.983931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.984346 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.984483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.984614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.984753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.984894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985036 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985576 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.985987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986257 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986670 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.986945 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987213 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987484 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.987890 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988166 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.988874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.989021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.989153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117769) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.990734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.991735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.992738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.993628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.994758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.995760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.996976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.997950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.998790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:00.999871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.001851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.003011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.004249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.006300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.007627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.008684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.009596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.011318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.012396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.013521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.014741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.015873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.017150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.018252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.019923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.020170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.020577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.021424 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.021424 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.021742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.021894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.022113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.022429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.022740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.023069 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.023379 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.023691 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.024080 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.024426 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.024780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.025067 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.025376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.025688 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.026006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.026328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.026655 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.026978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.027307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.027617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.027940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.028402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.028633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.028983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.029311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.029627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.029941 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.030247 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:23:01.030491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117768) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:23:01.110954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO dbcounter [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Registered counter for database nova_api Jul 20 19:23:01.132489 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_db.sqlalchemy.engines [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.139416 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writer thread running {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.182681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO dbcounter [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Registered counter for database nova_api Jul 20 19:23:01.197787 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.context [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b072c1f4-5db9-429c-b0e6-4cf58b6cf08c(cell1) {{(pid=117769) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:23:01.202485 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:01.203630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.203953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:01.204956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:01.207018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:01.209801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO dbcounter [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Registered counter for database nova_cell0 Jul 20 19:23:01.211515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writer thread running {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.214074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO dbcounter [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Registered counter for database nova_cell1 Jul 20 19:23:01.225856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_db.sqlalchemy.engines [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.227453 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_db.sqlalchemy.engines [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.233435 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writer thread running {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.234770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writer thread running {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.271416 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.context [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b072c1f4-5db9-429c-b0e6-4cf58b6cf08c(cell1) {{(pid=117768) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 19:23:01.275825 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:01.277450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:01.278634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:01.280912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:01.283195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO dbcounter [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Registered counter for database nova_cell0 Jul 20 19:23:01.288343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO dbcounter [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Registered counter for database nova_cell1 Jul 20 19:23:01.298528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.301388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.306813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writer thread running {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.308475 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writer thread running {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.388055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO dbcounter [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Registered counter for database nova_cell0 Jul 20 19:23:01.395151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_db.sqlalchemy.engines [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117769) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.400450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writer thread running {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.462871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO dbcounter [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Registered counter for database nova_cell0 Jul 20 19:23:01.469643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_db.sqlalchemy.engines [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117768) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:23:01.476447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writer thread running {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:23:01.724116 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: WARNING keystonemiddleware.auth_token [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:23:01.731384 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: WARNING keystonemiddleware.auth_token [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:23:01.798510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: WARNING keystonemiddleware.auth_token [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:23:01.806476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: WARNING keystonemiddleware.auth_token [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:23:02.080970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: WARNING keystonemiddleware.auth_token [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:23:02.088002 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: WARNING keystonemiddleware.auth_token [None req-a14a2731-29e8-4656-9420-47592809f4ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:23:02.094557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe015179c0 pid: 117769 (default app) Jul 20 19:23:02.187648 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: WARNING keystonemiddleware.auth_token [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 19:23:02.194282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: WARNING keystonemiddleware.auth_token [None req-0cc84bb4-01d8-422a-9b2f-58fa0ce8e2d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 19:23:02.201877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe015179c0 pid: 117768 (default app) Jul 20 19:23:52.732864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:52.734349 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:52.735447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:52.741965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:54.157026 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1286405132", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:23:54.973219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] validate_networks() for [('cb30eef5-f970-4e36-86fc-a729873274d6', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:23:58.640145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:23:58.641496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:23:58.642131 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:23:58.642687 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:23:58.643237 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:23:58.688738 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:58.690685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:58.694692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:23:58.695477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:23:58.816087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:23:58.843266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for user cb06eeba738b452fab3986de7e1f7856 and project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:23:58.878539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:23:58.881799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:23:59.118483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-061e8dfe-ce33-4380-91ec-6124937624dd tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.398113 Jul 20 19:23:59.119403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:23:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 6404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:23:59.136895 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:59.145225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:59.149332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:59.151533 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:23:59.994224 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-28312bb6-a8a9-46d4-9697-5a8f008e07f0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:23:59.998706 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-28312bb6-a8a9-46d4-9697-5a8f008e07f0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:01.524630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-28312bb6-a8a9-46d4-9697-5a8f008e07f0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:01.541378 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-28312bb6-a8a9-46d4-9697-5a8f008e07f0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1222 microversion: 2.1 time: 2.413552 Jul 20 19:24:01.542770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:23:59 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1222 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:02.187470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1837741532", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:02.407578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] validate_networks() for [('cb30eef5-f970-4e36-86fc-a729873274d6', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:02.969121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1327172894", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "networks": [{"uuid": "9a9193de-984d-406f-a548-19b5a7c18792"}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:03.081506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] validate_networks() for [('9a9193de-984d-406f-a548-19b5a7c18792', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:04.367640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:04.369738 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:04.370394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:04.371149 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:04.371823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:04.397950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:04.398455 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:04.403058 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:04.403598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:04.483020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Getting quotas for project 5231dfdf49c44f7ab191159ea563dad7. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:04.515969 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Getting quotas for user 3b7b1014c466482b95820616b54dd13a and project 5231dfdf49c44f7ab191159ea563dad7. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:04.566647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:04.591042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:04.632166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:04.633159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:04.633779 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:04.634382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:04.634945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:04.667328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:04.668047 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:04.673265 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:04.674499 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:04.740973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-73a85110-0a3a-4705-a627-4c7c64e48df0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.786309 Jul 20 19:24:04.750766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:24:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:24:04.805739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:04.830231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for user cb06eeba738b452fab3986de7e1f7856 and project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:04.876877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:04.893638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:05.087430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-377b3ace-2784-488e-b2fa-b377135b1078 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.911003 Jul 20 19:24:05.088763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 2/4] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:24:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:24:05.097999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-befc96eb-517d-462e-8591-f5417005f2b2 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:05.099517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-befc96eb-517d-462e-8591-f5417005f2b2 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:05.282707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-befc96eb-517d-462e-8591-f5417005f2b2 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:05.293526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-befc96eb-517d-462e-8591-f5417005f2b2 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1215 microversion: 2.1 time: 0.201081 Jul 20 19:24:05.296841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:05 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:05.316834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-390ef395-f33f-4e65-97da-031b49af8f21 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:05.322438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-390ef395-f33f-4e65-97da-031b49af8f21 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:05.465643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-390ef395-f33f-4e65-97da-031b49af8f21 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:05.481175 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-390ef395-f33f-4e65-97da-031b49af8f21 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1222 microversion: 2.1 time: 0.179151 Jul 20 19:24:05.482299 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 4/6] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:05 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:05.710171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5b4fc781-b5b2-4073-b9d6-bd1b9ca94cae tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: .version_select at 0x7f26c2b3af70>, body: {"keypair": {"name": "tempest-keypair-701008186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIx8QJJluCoMB8Z6acqfdaR9SQGlAcqoizv2eev8pNTmE0PZoQ50WYbKUKw5W85N8QjqyMNbAOFDSyl8vPWjtyIoImHwN/UlOzH5OWhC5+HfzgjHtpRgpiDUFFhSUg4auQ=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:05.732876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5b7875b3-884e-4594-bfe5-afbb25c1a82d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: .version_select at 0x7f26c3376a60>, body: {"keypair": {"name": "tempest-keypair-317657895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZY/wbcUwrCAb+x7VGpS7PVa62R6wZg/xzgy06iTaMOOX3r/mjxzW3T4yt0UnrIP1oL9xOPlQ0rS2fKe8aZpFCQsamFxD7W9dWxPx4CtJ5MugE0XTGd+fdjaJSvTBHgcA=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:05.760330 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-5b4fc781-b5b2-4073-b9d6-bd1b9ca94cae tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for project ff9c443652a141d482130869ff76c327. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:05.778449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-5b4fc781-b5b2-4073-b9d6-bd1b9ca94cae tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for user 9ac790383bdf4eecaef96cc25fe38553 and project ff9c443652a141d482130869ff76c327. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:05.815962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-5b7875b3-884e-4594-bfe5-afbb25c1a82d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for project 654a322fff99416595c66a993aeaee17. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:05.827048 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-5b7875b3-884e-4594-bfe5-afbb25c1a82d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for user b15f8d66d5104aaeae51e6c1fa3b3596 and project 654a322fff99416595c66a993aeaee17. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:05.873431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5b4fc781-b5b2-4073-b9d6-bd1b9ca94cae tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.119316 Jul 20 19:24:05.875875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 3/7] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jul 20 19:24:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 19:24:05.953276 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5b7875b3-884e-4594-bfe5-afbb25c1a82d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.464836 Jul 20 19:24:05.963475 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 5/8] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:24:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:06.309955 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-99c7f56f-9a09-4340-a206-313d0f6f2a12 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:06.310568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-99c7f56f-9a09-4340-a206-313d0f6f2a12 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:06.500204 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:06.501293 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:06.516923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:06.517391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:06.520105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:06.520726 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:06.558580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-99c7f56f-9a09-4340-a206-313d0f6f2a12 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:06.623569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-99c7f56f-9a09-4340-a206-313d0f6f2a12 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1215 microversion: 2.1 time: 0.317533 Jul 20 19:24:06.624164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:06 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:07.178599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:07.225552 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f6094290-b02e-4ed0-b07e-226a1f34d6b3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1218 microversion: 2.1 time: 0.724790 Jul 20 19:24:07.226112 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:06 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1218 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:07.643968 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:07.645052 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:07.668113 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:07.673243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:07.675675 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:07.678711 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.243371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:08.244616 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:08.262754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.266954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:08.273870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:08.274871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:09.323067 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:09.333959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-711cb9f9-dc4e-4f7e-b53f-cfa7afa19e52 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1292 microversion: 2.1 time: 1.095657 Jul 20 19:24:09.340606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:08 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1292 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:09.370296 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:09.393676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ff34bbdc-698d-47e5-bfd7-6c6a8e947326 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1267 microversion: 2.1 time: 1.755957 Jul 20 19:24:09.398243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 5/12] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:07 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1267 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:10.358876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:10.359327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:10.368714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.371170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.374818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.376586 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.417916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:10.419164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:10.434160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.437086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.445578 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:10.451965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:10.646838 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.654802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-14c1276e-e8a9-4c91-b67b-d0a463c369d5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1280 microversion: 2.1 time: 0.303391 Jul 20 19:24:10.655385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 8/13] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:10 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:10.711478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:10.733848 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-33466bed-be3c-4644-8752-c38f4bdcd45f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1273 microversion: 2.1 time: 0.316699 Jul 20 19:24:10.745389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 6/14] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:10 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:11.675674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:11.676643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:11.694131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.694867 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.697715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.705203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.762500 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:11.763245 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:11.779139 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.779662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:11.790992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:11.792949 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:12.266123 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:12.280081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:12.302114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b787da46-dd65-439d-99c4-c90ca6611253 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1273 microversion: 2.1 time: 0.544276 Jul 20 19:24:12.312096 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:11 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1273 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:12.331763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8d1d6e85-fefc-4ef4-a924-9187e15c75af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1280 microversion: 2.1 time: 0.660034 Jul 20 19:24:12.362801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:11 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1280 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:13.328741 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:13.329490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:13.347151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.349648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.350751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.352175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.378101 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:13.380153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:13.415423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.417171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.420769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:13.425320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:13.823153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.843632 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3de1d879-2563-4146-bf9d-13d0873affb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1280 microversion: 2.1 time: 0.469820 Jul 20 19:24:13.860012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 10/17] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:13 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1280 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:13.880984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:13.892102 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-06b79f06-1b15-4e18-8303-c8f5c8b096b5 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1273 microversion: 2.1 time: 0.567134 Jul 20 19:24:13.893013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 8/18] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:13 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1273 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:14.864147 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:14.865917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:14.875506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:14.881151 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.883606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.886644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.888564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.911772 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:14.913940 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:14.928271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:14.934735 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.936192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:14.944106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:14.946446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:15.726168 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:15.744529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fd958c01-5b87-482b-b231-18b1253d0885 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.885285 Jul 20 19:24:15.745265 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 11/19] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:14 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:15.763490 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-702534037", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5bb1c67-48ca-4e2c-b322-fdd0133524e4"}], "security_groups": [{"name": "tempest-securitygroup--1699305173"}], "key_name": "tempest-keypair-317657895", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:15.841996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=16 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:16.128139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] validate_networks() for [('f5bb1c67-48ca-4e2c-b322-fdd0133524e4', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:16.576905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=18 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:16.891209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:16.892304 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:16.893100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:16.893753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:16.894276 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:16.919923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.920629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.921606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:16.922673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:16.946319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for project 654a322fff99416595c66a993aeaee17. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:16.951483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for user b15f8d66d5104aaeae51e6c1fa3b3596 and project 654a322fff99416595c66a993aeaee17. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:16.972023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:16.975916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:16.986780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:17.007443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-11c7fcfc-82c7-4e96-81a3-c879fb822197 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 2.100926 Jul 20 19:24:17.008957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 9/20] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:14 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:17.024441 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:17.025828 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:17.041989 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.045027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.046755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:17.048498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:17.097962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4682854e-5b93-4b30-ab00-77a6d56350fe tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.351555 Jul 20 19:24:17.102502 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 12/21] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:24:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:24:17.122711 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1089032948", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab609c42-592c-4da6-88a0-b462f1083b16"}], "security_groups": [{"name": "tempest-securitygroup--1438046530"}], "key_name": "tempest-keypair-701008186", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:17.321876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] validate_networks() for [('ab609c42-592c-4da6-88a0-b462f1083b16', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:24:18.331221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:18.346486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-624ceba8-bc7d-4a22-9798-80b43805cb4b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 1.335256 Jul 20 19:24:18.348946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 10/22] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:17 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:18.363016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:18.364498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:18.378668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.379445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:18.381059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:18.381493 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.212810 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:24:19.213323 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:24:19.213699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:24:19.214157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:24:19.214635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:24:19.238171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.239783 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.243051 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.244855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.308656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for project ff9c443652a141d482130869ff76c327. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:24:19.315569 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for user 9ac790383bdf4eecaef96cc25fe38553 and project ff9c443652a141d482130869ff76c327. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:24:19.344972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:24:19.359442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:24:19.364790 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.372656 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-67d1097e-087b-4df7-90e7-11d6fbe863e7 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1232 microversion: 2.1 time: 1.021064 Jul 20 19:24:19.383410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:18 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1232 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:19.399273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:19.405236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:19.433157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.434595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.446461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.447813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.465152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6d6b1a23-d099-4f66-bc99-ef70d3065be2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.359865 Jul 20 19:24:19.468558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 13/24] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jul 20 19:24:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 19:24:19.916619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-0a3cd49f-e310-4cfd-9f1c-b41316e4203b req-81e3c1c5-54b7-407e-be56-4850e52e15c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057f48c6-98d1-43fb-ab77-526c7ff0cf07", "tag": "b88207bd-7c1f-4302-9d14-7ef3931098c7"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:19.919839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:19.929588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4cac9e57-7dcd-45ec-a7a6-de30d02beeb6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.535162 Jul 20 19:24:19.939048 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-0a3cd49f-e310-4cfd-9f1c-b41316e4203b req-81e3c1c5-54b7-407e-be56-4850e52e15c2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.939371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-0a3cd49f-e310-4cfd-9f1c-b41316e4203b req-81e3c1c5-54b7-407e-be56-4850e52e15c2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.947425 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:19 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:19.953616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:19.963505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:19.976727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.979644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:19.980762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:19.984266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.029023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-0a3cd49f-e310-4cfd-9f1c-b41316e4203b req-81e3c1c5-54b7-407e-be56-4850e52e15c2 service nova] Creating event network-changed:b88207bd-7c1f-4302-9d14-7ef3931098c7 for instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 on hv-cinder-81914 Jul 20 19:24:20.033078 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-0a3cd49f-e310-4cfd-9f1c-b41316e4203b req-81e3c1c5-54b7-407e-be56-4850e52e15c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117768) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:24:20.037436 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06981962-752c-484a-bb80-74b82498560c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.043899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06981962-752c-484a-bb80-74b82498560c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.046303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06981962-752c-484a-bb80-74b82498560c None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.046754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06981962-752c-484a-bb80-74b82498560c None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.092826 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.compute.rpcapi [None req-06981962-752c-484a-bb80-74b82498560c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:24:20.100199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06981962-752c-484a-bb80-74b82498560c None None] Releasing lock "compute-rpcapi-router" {{(pid=117768) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:24:20.154071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-06981962-752c-484a-bb80-74b82498560c None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.683961 Jul 20 19:24:20.155199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:20.166854 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:20.171052 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:20.351092 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.376714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.382353 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.384070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d886d626-8d9f-43b3-ac5d-e70561ec87be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1281 microversion: 2.20 time: 0.225627 Jul 20 19:24:20.387819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 15/27] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:20 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:20.411725 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:20.412969 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:20.466819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.471123 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.492789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:20.493860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:20.778227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.794705 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4db027d2-cef3-456c-ab96-82fc42da4a3c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1288 microversion: 2.1 time: 0.397002 Jul 20 19:24:20.799226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 16/28] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:20 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1288 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:20.956747 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:20.966285 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:20.968047 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.027192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-db51ec75-198f-45e8-8355-dc292d9653b7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 1.066363 Jul 20 19:24:21.031292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 13/29] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:19 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:21.041272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.047200 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.055127 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.412025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:21.414756 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.424923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.425656 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.428229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.429443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.509773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.525738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-905cf597-e0be-4249-a0f9-366180cee685 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.566518 Jul 20 19:24:21.535134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 17/30] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:20 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:21.741281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.750013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.751545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.753138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-025b6e88-1997-4e9a-8bcf-8d258670e9d8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1277 microversion: 2.20 time: 0.347579 Jul 20 19:24:21.754183 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 14/31] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:21 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1277 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:21.815673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:21.816675 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:21.824305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:21.826278 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.827099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.828100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:21.828733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:21.934681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:21.943459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-60107bdf-bd45-4c8d-9ee5-6f279a47662e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.132208 Jul 20 19:24:21.944229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 18/32] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:21 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:22.047408 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.047960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.054682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.055119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.055878 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.056525 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.218011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.229544 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-db5591dc-0afe-4a06-b3ae-e2d5588ecd44 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.185798 Jul 20 19:24:22.230144 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 19/33] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:22.235277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-f74cc855-6521-453a-ad33-6ab5c39bb72a req-164cbd22-a400-4581-9ad0-a637bf0cf6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2a941f-55c0-4b7d-a7fb-441d99569c0a", "tag": "12c14f37-54d6-465f-98a8-80c125855fe5"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:22.244733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-f74cc855-6521-453a-ad33-6ab5c39bb72a req-164cbd22-a400-4581-9ad0-a637bf0cf6b4 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.245231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-f74cc855-6521-453a-ad33-6ab5c39bb72a req-164cbd22-a400-4581-9ad0-a637bf0cf6b4 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.262905 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-f74cc855-6521-453a-ad33-6ab5c39bb72a req-164cbd22-a400-4581-9ad0-a637bf0cf6b4 service nova] Creating event network-changed:12c14f37-54d6-465f-98a8-80c125855fe5 for instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a on hv-cinder-81914 Jul 20 19:24:22.272195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-f74cc855-6521-453a-ad33-6ab5c39bb72a req-164cbd22-a400-4581-9ad0-a637bf0cf6b4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039953 Jul 20 19:24:22.272861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 20/34] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:22.295857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-ed101eed-4735-448f-9c6f-f646c4bf246b req-cb855e9b-c72d-4945-8c9a-bea90646742a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5754cfb-a037-4363-8936-15978c89549e", "tag": "d1b2ec4f-4809-4219-9acc-9861fab9de05"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:22.312580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-ed101eed-4735-448f-9c6f-f646c4bf246b req-cb855e9b-c72d-4945-8c9a-bea90646742a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.313027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-ed101eed-4735-448f-9c6f-f646c4bf246b req-cb855e9b-c72d-4945-8c9a-bea90646742a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.340219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-ed101eed-4735-448f-9c6f-f646c4bf246b req-cb855e9b-c72d-4945-8c9a-bea90646742a service nova] Creating event network-changed:d1b2ec4f-4809-4219-9acc-9861fab9de05 for instance e5754cfb-a037-4363-8936-15978c89549e on hv-cinder-81914 Jul 20 19:24:22.340777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-ed101eed-4735-448f-9c6f-f646c4bf246b req-cb855e9b-c72d-4945-8c9a-bea90646742a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 19:24:22.342171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.342612 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.344160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.344887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.360622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.compute.rpcapi [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 19:24:22.361519 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] Releasing lock "compute-rpcapi-router" {{(pid=117769) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 19:24:22.393360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8e7d17ef-664c-48fe-9b92-ab9500b69b56 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.458303 Jul 20 19:24:22.394419 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 15/35] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:22.564763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.565659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.572570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.573154 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.573934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.574385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.717591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.728187 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6768204a-1b0e-4cee-9579-a43a5d073034 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.170130 Jul 20 19:24:22.737865 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 21/36] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:22.775762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.775762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.781708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.782247 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.784005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.785051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.867454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.870156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=73 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:22.877648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.879481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:22.881182 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8489c03f-da88-419c-8e5f-25edb1db09e1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1277 microversion: 2.20 time: 0.112440 Jul 20 19:24:22.881684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 16/37] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:22.961340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:22.961953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:22.968053 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.968470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:22.969234 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:22.969661 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.051224 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.060306 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c6a353d5-e9ee-4602-8cf2-6f5a77aec7cf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.103251 Jul 20 19:24:23.061219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 22/38] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:22 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:23.246813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.247825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.249373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:23.257171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.257817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.258732 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.259356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.458662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.470265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-55d31037-fd99-49b8-8b3f-6f56b8485937 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.227684 Jul 20 19:24:23.471125 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 17/39] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:23.747023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.747023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.752361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.752822 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.753672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.754373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.899593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:23.900345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:23.905134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.911543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.912957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.913749 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:23.914146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-049c3de8-d81c-4520-a74a-fa6bf98bc08e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.172820 Jul 20 19:24:23.914263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:23.924100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 23/40] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:23.986223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:23.994893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.021495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.022669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f46d646d-97ee-4d46-94ae-c4c500f867cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.127607 Jul 20 19:24:24.023327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 18/41] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:23 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:24.079835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:24.080613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:24.088599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.089427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.096483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.097040 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.237538 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.252518 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fdd3ac3a-efd5-4949-bf7d-75abc3893614 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.176947 Jul 20 19:24:24.253109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 24/42] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:24 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:24.488239 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:24.489835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:24.497500 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.498395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.499478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.500257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.711570 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:24.734734 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ec8da180-bec1-4c3a-b6f4-7876e49ef45a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.250986 Jul 20 19:24:24.736081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 19/43] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:24 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:24.931550 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:24.932156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:24.943367 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.944224 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.945605 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:24.946056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:24.972606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:25.044118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.044818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.055668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.056126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.060310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.060958 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.172652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.181901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b44fa946-ea38-4af5-9519-8c6ab196d47d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.254041 Jul 20 19:24:25.190492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 25/44] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:24 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:25.196915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.205954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.208072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.209788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5904ff8b-e44d-4717-8d6f-db5a78fce442 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.170589 Jul 20 19:24:25.210490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 20/45] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:25.272100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.272764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.283958 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.284886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.286495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.291001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.483311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.492201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0971e0f8-3fdb-42c2-af84-d1ead8ff0e68 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.225189 Jul 20 19:24:25.492933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 26/46] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:25.755289 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:25.755877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:25.761945 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.762385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.763125 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:25.763552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:25.903837 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:25.911711 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4b180944-4d9b-47d0-a0cb-eda76878b8a1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.161213 Jul 20 19:24:25.912312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 21/47] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:25 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.198951 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.200584 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.207590 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.208348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.209308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.209751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.228859 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.229474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.242647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.244536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.245571 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.249377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.337318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.353259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.355825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.362653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bd025c07-3e5e-4a12-ae52-5e1f3ccd6ed7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.133186 Jul 20 19:24:26.365706 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 22/48] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:26.464740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.474617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b1b58a6b-c131-493a-860a-b0bd31a32b24 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.279426 Jul 20 19:24:26.475747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 27/49] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.513899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.514537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.522520 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.523226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.524350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.524987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.648216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:26.674078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-73875acd-cf23-4b9f-b248-c0c2677a9420 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.166027 Jul 20 19:24:26.674674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 23/50] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:26.928136 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:26.928776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:26.934748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.935198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:26.935962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:26.936433 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.070039 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.077469 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-50c7b3e1-a5fd-4308-a035-c249360dd4b8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.153175 Jul 20 19:24:27.078026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 28/51] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:26 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:27.382072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.382674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.388958 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.389373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.390150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.390590 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.495138 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.495724 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.502422 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.502875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.503668 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.504109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.625997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.637206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.639040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.640278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-62dc9382-0a1b-4640-927e-c5cae7b42f55 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.262155 Jul 20 19:24:27.640942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 24/52] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:27.654997 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.662483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b70718d1-e128-40e6-94a2-bc054dfb2ee6 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.171780 Jul 20 19:24:27.663050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 29/53] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:27.695408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:27.696008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:27.702215 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.702660 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.703415 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:27.703849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:27.767788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:27.780235 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f76bbff3-6edb-4f76-b185-a90cd229762a tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.089165 Jul 20 19:24:27.780959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 25/54] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:27 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:28.092955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.093562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.100523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.100974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.101740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.102176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.233817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.242478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-274d74e8-a7b6-401d-81d9-23a948b9fec9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.153233 Jul 20 19:24:28.243094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 30/55] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:28.658904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.659431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.666344 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.666782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.667552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.667981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.679585 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.680184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.686482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.687179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.687935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.688392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.734084 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.748072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.750281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.751467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bae029ca-51c3-4b3c-bddd-9553fbf5e4bb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.096544 Jul 20 19:24:28.752035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 26/56] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:28.803504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:28.804593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:28.813082 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.814274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.815562 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:28.816394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:28.824340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.840782 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-58bb339c-efa8-40fa-b65d-5ff7fad8a096 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.165789 Jul 20 19:24:28.848174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 31/57] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:28.882596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:28.889912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-63076e1e-d59d-49d9-a95a-f2cba04f0c56 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1296 microversion: 2.1 time: 0.092089 Jul 20 19:24:28.890471 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 27/58] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:28 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:29.259745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.260507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.266791 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.267246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.268017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.268493 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.482505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.490750 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-76d6a1d3-1fe5-4f02-a1a5-999771d63fed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.234848 Jul 20 19:24:29.491326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:29.769991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.770628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.777839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.778293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.779303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.780465 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.857316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.857920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.866042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.869244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.871210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.873161 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.876529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.883609 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.886821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:29.888836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-16fa2aa0-6248-4d1f-92d7-ae127eeb1436 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.122350 Jul 20 19:24:29.908615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 28/60] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:29.913998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:29.914715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:29.921011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.921667 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:29.922619 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:29.923207 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.039043 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.046485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-80186a92-e0ca-4df6-a351-b61d1ecb5b5c tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.192949 Jul 20 19:24:30.047602 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 33/61] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:30.080240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.087923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a1915591-0002-44fd-912e-c91fcad77c12 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.178145 Jul 20 19:24:30.088783 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 29/62] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:29 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:30.508508 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:30.509144 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:30.511035 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:30.511677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=14 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:30.517528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.517972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.518733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.519163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.661863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.670008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f98e48e6-f43f-4937-a0d3-f17f929b0574 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.165770 Jul 20 19:24:30.670594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 34/63] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:30 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:30.915470 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:30.916068 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:30.922010 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.922438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.923190 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:30.923618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:30.986707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.995534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.997091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:30.998187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e4467bf4-aa7f-421c-8e9e-db4ae58c8ce0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.087151 Jul 20 19:24:30.998748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 30/64] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:30 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:31.063744 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:31.064357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:31.071238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.071677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.072466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.072904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.106091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:31.106692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:31.113604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.114055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.115015 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.115451 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.218917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.232425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-91fdde9c-cea1-40d1-b4a7-a58879296037 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.172761 Jul 20 19:24:31.233396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 35/65] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:31 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:31.263447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.271322 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a0cbcfa7-7f0c-4881-9496-e361409b48f5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.169373 Jul 20 19:24:31.271892 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 31/66] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:31 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:31.687441 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:31.687931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:31.694629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.695089 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.695938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:31.696429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:31.830468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:31.838208 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-366e9716-b5a5-4ed9-b4e3-115157145e20 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.154954 Jul 20 19:24:31.838788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 36/67] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:31 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:32.016350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.016950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.023528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.023967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.024765 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.025186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.156967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.167734 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.169704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.171096 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-21173a4f-333c-4503-a204-035930485335 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1333 microversion: 2.20 time: 0.158607 Jul 20 19:24:32.171773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 32/68] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:32.251019 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.252241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.260788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.261428 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.262452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.263102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.289937 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.297181 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.314234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.315327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.317602 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.318902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.348797 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:32.362661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:32.723108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.731027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c9c94aad-14a3-4085-a337-e79cf1a3e7e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.445542 Jul 20 19:24:32.731715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 33/69] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:32.838050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:32.845698 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dc547ebf-4a0c-46c0-a348-74c652f61a94 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.598396 Jul 20 19:24:32.846277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 37/70] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:32.860766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:32.861373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:32.867913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.868402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:32.869176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:32.869606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.054552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.070800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-005a9061-e8ef-46da-8ba0-6e555857ab43 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.213720 Jul 20 19:24:33.079101 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 34/71] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:32 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:33.190398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:33.191375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.202657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.203115 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.203902 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.204377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.286201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.295082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.296637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.297767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a36f891d-c16d-4937-9d39-199ed223a633 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1339 microversion: 2.20 time: 0.112121 Jul 20 19:24:33.298328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 38/72] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:33 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:33.338931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-a3d564c8-650e-4e3c-bc3a-812f9abfd7d9 req-0b90e27d-e1c5-47e6-8a8c-2544aa7e3753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f977b5-705c-46e5-b597-311c97d2edea", "tag": "a8824afd-c0c0-48f6-a2ee-5085bf6628cf"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:33.355720 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-a3d564c8-650e-4e3c-bc3a-812f9abfd7d9 req-0b90e27d-e1c5-47e6-8a8c-2544aa7e3753 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.356475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-a3d564c8-650e-4e3c-bc3a-812f9abfd7d9 req-0b90e27d-e1c5-47e6-8a8c-2544aa7e3753 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.377218 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-a3d564c8-650e-4e3c-bc3a-812f9abfd7d9 req-0b90e27d-e1c5-47e6-8a8c-2544aa7e3753 service nova] Creating event network-changed:a8824afd-c0c0-48f6-a2ee-5085bf6628cf for instance 58f977b5-705c-46e5-b597-311c97d2edea on hv-cinder-81914 Jul 20 19:24:33.383012 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-a3d564c8-650e-4e3c-bc3a-812f9abfd7d9 req-0b90e27d-e1c5-47e6-8a8c-2544aa7e3753 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050175 Jul 20 19:24:33.383618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 35/73] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:33.747994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:33.748548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.754592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.755038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.755798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.756232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.863327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:33.864012 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:33.870832 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.871275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.872034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:33.872495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:33.886076 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:33.893747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1864ea24-14d0-4168-ae1e-1ad758106a8b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.149328 Jul 20 19:24:33.894325 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 39/74] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:33 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:34.002294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.009683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f831e927-dd8b-4c4c-a1b9-68fa457dff51 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.150459 Jul 20 19:24:34.010250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 36/75] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:33 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:34.088606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.089210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.095310 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.095753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.096536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.096966 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.225739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.232016 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-10c2e4a0-a77c-4988-b677-bbe588bc324c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.147210 Jul 20 19:24:34.232596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 40/76] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:34.315998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.316629 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.322662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.323105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.323865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.324310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.386733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.394597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.396094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:34.397774 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-70ab415f-43cd-46d6-8f4e-71262859e172 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1339 microversion: 2.20 time: 0.085913 Jul 20 19:24:34.398332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 37/77] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:34.910465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:34.910998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:34.916959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.917404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:34.918153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:34.918581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.026307 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.026936 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.032803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.033249 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.034000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.034433 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.047497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.055497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5917529b-11f2-4242-82b4-ee37636c099f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.148890 Jul 20 19:24:35.056062 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 41/78] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:34 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:35.166006 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.174040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-85066722-05a7-4ba8-a051-ca50ebe28c39 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.151551 Jul 20 19:24:35.174618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 38/79] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:35.248695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.249304 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.255693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.256163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.256951 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.257384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.261395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:35.415704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:35.416383 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:35.423505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.424105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.424986 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:35.425649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:35.542087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.551154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.551629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.552983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:35.554328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4f9234b0-52a1-4cbf-a3ef-8823be636d2e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1339 microversion: 2.20 time: 0.143292 Jul 20 19:24:35.555115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 39/80] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1339 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:35.559281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7caedcd8-1b31-4e9a-86f3-74b8b2d17c30 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.314527 Jul 20 19:24:35.559837 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 42/81] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:35 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:36.073444 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.074054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.080216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.080695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.081458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.081893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.191170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.191776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.198676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.199259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.200031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.200497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.216926 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.224149 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9d5f391b-9593-49b7-8470-d8bee6d5a269 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.154650 Jul 20 19:24:36.233494 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 40/82] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:36.355947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.363335 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-db1de43b-9dde-4213-b177-53389d7608cd tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.176297 Jul 20 19:24:36.363900 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 43/83] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:36.575465 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.576768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.577040 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:36.578146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:36.583993 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.584760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.585718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.586297 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.587099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.587220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.588326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:36.588924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:36.804948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.817069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.823472 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:36.828357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3aa0c20e-6234-456c-88cd-23980c4d5c37 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1339 microversion: 2.20 time: 0.257847 Jul 20 19:24:36.829134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 41/84] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1339 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:37.195898 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.212325 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3c1c7c03-1709-462d-8f29-5bcb99a14006 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.639250 Jul 20 19:24:37.214899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 44/85] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:36 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:37.243416 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.246900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.257576 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.269964 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.272897 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.273464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.393466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.393990 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.430938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.431389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.432192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.432644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.875785 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.883964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-06f9065b-4833-44f8-ba5b-7d1af122b281 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.496658 Jul 20 19:24:37.884683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 45/86] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:37.889692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:37.890691 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:37.897736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.898492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.899313 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:37.899746 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:37.917630 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:37.925421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1fcc73a9-a75e-4f88-a171-7253f673b4a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.687664 Jul 20 19:24:37.938950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 42/87] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:37.997581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.013991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.015673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.016994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3b04cf91-7467-40ed-9e7a-3027e55472ec tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1339 microversion: 2.20 time: 0.130669 Jul 20 19:24:38.017834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 46/88] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:37 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:38.232959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.233942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.259005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.259659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.260472 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.260960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.562970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:38.575802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-40436d03-1a06-46f2-bfcb-0f764c1c7458 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.348426 Jul 20 19:24:38.577059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 43/89] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:38.901595 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.902916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.909398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.909841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.910681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.911179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.954017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:38.968499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:38.985744 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.986186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:38.986961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:38.987387 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.136155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.148013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-aaaf3953-ce92-4979-a707-e9b2dab95ecb tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.250698 Jul 20 19:24:39.149458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 47/90] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:39.154314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:39.155396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:39.165363 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.166489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.167375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.167982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.336704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.349302 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.353314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.357382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5db24b6c-4368-4a17-8490-39ec321e49fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.206630 Jul 20 19:24:39.358554 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 48/91] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:39 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:39.520982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.542700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3ce026ee-8359-4e45-b765-4e4abd02cf58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.599325 Jul 20 19:24:39.543953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 44/92] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:38 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:39.592956 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:39.593893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:39.600623 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.601152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.601993 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:39.602501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:39.836484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:39.844339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c3cfe939-97df-4f8b-a98a-8bc43695c558 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.255067 Jul 20 19:24:39.856634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 49/93] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:39 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:40.170679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.172538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.181059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.181603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.182466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.182968 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.299134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-57caed42-3a88-4530-9929-1bd72589bc8a req-4d2e9083-6dd8-4754-81c9-cca51889c0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:40.314227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-57caed42-3a88-4530-9929-1bd72589bc8a req-4d2e9083-6dd8-4754-81c9-cca51889c0b2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.315767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-57caed42-3a88-4530-9929-1bd72589bc8a req-4d2e9083-6dd8-4754-81c9-cca51889c0b2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.329109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-57caed42-3a88-4530-9929-1bd72589bc8a req-4d2e9083-6dd8-4754-81c9-cca51889c0b2 service nova] Creating event network-changed:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:24:40.359423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-57caed42-3a88-4530-9929-1bd72589bc8a req-4d2e9083-6dd8-4754-81c9-cca51889c0b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063969 Jul 20 19:24:40.360055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 50/94] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:40.384498 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.385482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.392681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.393466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.394454 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.395264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.477443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.485972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-98eee730-4e12-445c-b766-f9c1e645ad4d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.322889 Jul 20 19:24:40.506910 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 45/95] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:40.567171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.567842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.583597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.584126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.590454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.592462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.641162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.652859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.654876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.656734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fab93c14-56f9-47f6-9e14-1867d87aa566 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.277952 Jul 20 19:24:40.657818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 51/96] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:40.862496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:40.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:40.870839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.871294 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.877613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:40.883311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:40.937498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:40.948528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5852403c-26cd-41b4-9222-38bdfad168ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.390266 Jul 20 19:24:40.949144 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 46/97] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:41.099111 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:41.107232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e33989bf-5877-49e1-9ec2-6d400cf4eb99 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.248949 Jul 20 19:24:41.107813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 52/98] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:40 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:41.512310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.513589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.524548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.525005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.530219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.533717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.879801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-0689e3a2-3ea2-4f6f-9b15-6f6e90cf69cb req-e395bd80-ea5b-4548-972c-e24a003e694d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057f48c6-98d1-43fb-ab77-526c7ff0cf07", "name": "network-vif-plugged", "status": "completed", "tag": "b88207bd-7c1f-4302-9d14-7ef3931098c7"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:41.908226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-0689e3a2-3ea2-4f6f-9b15-6f6e90cf69cb req-e395bd80-ea5b-4548-972c-e24a003e694d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.908844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-0689e3a2-3ea2-4f6f-9b15-6f6e90cf69cb req-e395bd80-ea5b-4548-972c-e24a003e694d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.909884 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:41.922591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-888881f4-d147-49dd-a08b-a445c5adcb86 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.418915 Jul 20 19:24:41.923931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 47/99] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:41.924887 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-0689e3a2-3ea2-4f6f-9b15-6f6e90cf69cb req-e395bd80-ea5b-4548-972c-e24a003e694d service nova] Creating event network-vif-plugged:b88207bd-7c1f-4302-9d14-7ef3931098c7 for instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 on hv-cinder-81914 Jul 20 19:24:41.932012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-0689e3a2-3ea2-4f6f-9b15-6f6e90cf69cb req-e395bd80-ea5b-4548-972c-e24a003e694d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288398 Jul 20 19:24:41.932202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.932710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.935137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 53/100] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:41.947198 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.947648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.948449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.949042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.969470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:41.971051 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:41.984407 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.986621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:41.987960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:41.990564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.250524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.263250 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ff88a7ca-7cba-4075-bb0d-4a62ec64d1f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.299075 Jul 20 19:24:42.275341 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 54/101] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:42.279863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:42.281135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:42.289047 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.289834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.290890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.291523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.334489 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.355042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.356593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.357739 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f29c35fe-af9a-4030-82f0-316696096c27 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.432649 Jul 20 19:24:42.358303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 48/102] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:41 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:42.468741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:42.479097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-29f66bb0-71e2-4043-af5b-7ae24b153891 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.206433 Jul 20 19:24:42.488735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 55/103] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:42 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:42.939413 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:42.940880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:42.949888 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.950339 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:42.951109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:42.951704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.179785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.189246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4947150c-6a6a-48e7-a3b3-99e0decf122d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.253946 Jul 20 19:24:43.190274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 49/104] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:42 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:43.283002 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.283949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.296530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.302934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.306376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.307394 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.376447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.377392 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.384396 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.385154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.386144 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.386787 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.516515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.525733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7c8a3af4-690b-46f8-b291-3c1cdf36e338 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.246538 Jul 20 19:24:43.526778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 56/105] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:43.545319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:43.546348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:43.552147 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.553532 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.554044 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.554879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:43.555046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:43.555435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:43.563907 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.565532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.567452 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7304ebff-2a8c-4c0c-abbd-d4683cb2225f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.195125 Jul 20 19:24:43.567974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 50/106] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:43.749527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:43.761029 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-24f96d03-989c-48df-836d-c648db8c5402 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.222530 Jul 20 19:24:43.762046 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 57/107] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:43 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:44.206098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:44.215339 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:44.225574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.226271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.227203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.227788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.399086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.416750 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-35313472-b685-4c09-915f-8e3edae39662 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.214585 Jul 20 19:24:44.426741 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 51/108] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:44 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:44.544775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:44.553134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:44.566195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.567959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.569451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.571098 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.587511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:44.588226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:44.598297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.598755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.602819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.604377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.774757 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.783077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-eb74733d-3ba7-4107-b190-a9dd1f38a624 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.243380 Jul 20 19:24:44.786559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 58/109] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:44 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:44.800859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:44.801778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:44.814627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.815089 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.824142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.824709 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:44.834563 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.847162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.850923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:44.853507 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b0b19eaf-ace9-4ba2-953f-c42d1a9d78a7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.271287 Jul 20 19:24:44.855120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 52/110] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:44 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:44.968547 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-8fe3de33-8522-45fb-b083-e5812e1a4b79 req-aa21a493-cf83-43d7-b23a-daff9743ba73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2a941f-55c0-4b7d-a7fb-441d99569c0a", "name": "network-vif-plugged", "status": "completed", "tag": "12c14f37-54d6-465f-98a8-80c125855fe5"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:44.996764 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8fe3de33-8522-45fb-b083-e5812e1a4b79 req-aa21a493-cf83-43d7-b23a-daff9743ba73 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:44.997210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8fe3de33-8522-45fb-b083-e5812e1a4b79 req-aa21a493-cf83-43d7-b23a-daff9743ba73 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.022593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-8fe3de33-8522-45fb-b083-e5812e1a4b79 req-aa21a493-cf83-43d7-b23a-daff9743ba73 service nova] Creating event network-vif-plugged:12c14f37-54d6-465f-98a8-80c125855fe5 for instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a on hv-cinder-81914 Jul 20 19:24:45.041518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-8fe3de33-8522-45fb-b083-e5812e1a4b79 req-aa21a493-cf83-43d7-b23a-daff9743ba73 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078442 Jul 20 19:24:45.043431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 53/111] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:45.076824 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:45.087174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-80ba54f8-f0de-4b86-be16-f612f445cb39 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.298728 Jul 20 19:24:45.088185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 59/112] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:44 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:45.433969 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:45.434857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:45.441596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.442704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.442947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.444246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.664615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:45.676268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7b1b2b49-856a-4259-870f-a927d1037f11 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.246397 Jul 20 19:24:45.677998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 54/113] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:45 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:45.804213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:45.805049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:45.811711 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.823069 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.824182 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.825635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.830883 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:45.874148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:45.875265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:45.884904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.886714 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:45.889793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:45.890464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.042844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.053610 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f6da1970-bd20-4bc6-90a6-ae7dc974705f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.253090 Jul 20 19:24:46.063776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 60/114] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:45 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:46.084626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.098207 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.099922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.101177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ddf86f57-a14e-4780-868e-c57c9d927341 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.232161 Jul 20 19:24:46.102021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 55/115] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:45 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:46.110951 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:46.111815 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:46.119643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.120125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.120981 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.121739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.260100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.267614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-77a7fb6c-5f33-4d3c-8f90-a90017eafd06 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1322 microversion: 2.1 time: 0.165581 Jul 20 19:24:46.268223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 61/116] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:46 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:46.694785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:46.695475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:46.705157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.706019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.707028 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:46.707477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:46.876377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:46.888191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ba32d925-3660-4390-a1bf-2666600c91cc tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.197630 Jul 20 19:24:46.897309 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 56/117] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:46 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:47.077431 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.078045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.084937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.085225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.086183 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.086781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.128219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.131421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.142580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.144000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.145210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.145880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.260752 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.270049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-94e44f3b-79d8-4b50-ab10-bb0700778562 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.201698 Jul 20 19:24:47.271123 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 62/118] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:47 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:47.291171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5754cfb-a037-4363-8936-15978c89549e", "name": "network-vif-plugged", "status": "completed", "tag": "d1b2ec4f-4809-4219-9acc-9861fab9de05"}, {"server_uuid": "58f977b5-705c-46e5-b597-311c97d2edea", "name": "network-vif-plugged", "status": "completed", "tag": "a8824afd-c0c0-48f6-a2ee-5085bf6628cf"}, {"server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "name": "network-vif-plugged", "status": "completed", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:47.328042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.329262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.372702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Creating event network-vif-plugged:d1b2ec4f-4809-4219-9acc-9861fab9de05 for instance e5754cfb-a037-4363-8936-15978c89549e on hv-cinder-81914 Jul 20 19:24:47.373468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Creating event network-vif-plugged:a8824afd-c0c0-48f6-a2ee-5085bf6628cf for instance 58f977b5-705c-46e5-b597-311c97d2edea on hv-cinder-81914 Jul 20 19:24:47.374402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] Creating event network-vif-plugged:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:24:47.384903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-81bd7ca8-b15b-47ee-8260-a37ab6e69a6b req-9ec76d52-9889-4186-82b7-c8e044c3d38e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.111903 Jul 20 19:24:47.387362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 63/119] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:47.394357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.397158 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.398031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.403752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.406111 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.407487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.409513 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.410174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.422597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.424188 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-24f477e9-5bda-47aa-8da7-d03fa2ccc521 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.309141 Jul 20 19:24:47.425023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 57/120] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:47 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:47.727624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:47.736365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-30c58453-2f17-4827-95ed-29f72ae1edfa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1516 microversion: 2.1 time: 0.344212 Jul 20 19:24:47.737179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:47 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1516 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:47.759069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:47.760257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.767679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.768231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.769108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.769716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.841981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'flavor' on Instance uuid 1a2a941f-55c0-4b7d-a7fb-441d99569c0a {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:24:47.905734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:47.907491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:47.917110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.921071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:47.923032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:47.925462 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.034637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cbd0717a-c140-4dcc-821a-8364f195cb14 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a/action" status: 200 len: 32 microversion: 2.1 time: 0.281391 Jul 20 19:24:48.036264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 58/122] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:24:47 2022] POST /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:24:48.047782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.049535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.059126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.060319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.062249 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.062967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.124707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.138402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7628b1c5-9a18-4166-b4b6-36b6bd236c34 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.233957 Jul 20 19:24:48.140119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 65/123] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:47 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:48.288267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.289171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.304443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.307020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.312391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.313015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.375464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.384367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-af332ff1-5e39-4538-8ebc-366efe87512a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.342214 Jul 20 19:24:48.393973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 59/124] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:48.445042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:48.445739 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:48.451970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.452655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.454009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:48.454487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:48.525856 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.539607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a66c9094-e01d-4682-b122-8cc3b1a83704 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.256108 Jul 20 19:24:48.540983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 66/125] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:48.614717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.624041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.625563 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:48.626371 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f54b8444-a856-488f-b776-bf7b32b9cee3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.185380 Jul 20 19:24:48.628849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 60/126] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:48 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:49.157238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.157901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.164160 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.164681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.165987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.166421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.309462 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.319686 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-92d56263-ae89-4f87-bf8f-3fbd2c09645e tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1315 microversion: 2.1 time: 0.166079 Jul 20 19:24:49.320605 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 67/127] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:49.401456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.402055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.408901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.410261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.411214 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.412393 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.560799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.561629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.566748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.572507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.573669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.574450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.574926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.576046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.584993 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3fa1511b-c068-4cf1-a25d-f812de8dac54 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.186399 Jul 20 19:24:49.587244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 61/128] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:49.646947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:49.648302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:49.654669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.655292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.656090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:49.656549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:49.794964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.806353 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-236bbfad-0072-4729-acdd-454a2466ba84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.252305 Jul 20 19:24:49.807257 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 68/129] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:49.830806 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.841067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.842868 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:49.870192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d0ec81ad-1d42-4423-b59a-b37af66e3273 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1407 microversion: 2.20 time: 0.202333 Jul 20 19:24:49.871259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 62/130] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:49 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:24:50.338930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:50.340150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:50.348792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.349539 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.351778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.352797 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.504221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:50.513913 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e6095522-cae5-4117-8956-6709c217b15f tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1502 microversion: 2.1 time: 0.178343 Jul 20 19:24:50.514957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 69/131] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:50 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:50.605931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:50.606620 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:50.619109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.620622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.623278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.625816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.825958 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:50.826569 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:50.837019 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.837471 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:50.841123 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:50.841579 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.162806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.171998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b6566920-f89b-422b-9a9f-60a267e2c827 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1362 microversion: 2.1 time: 0.351168 Jul 20 19:24:51.183628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 70/132] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:50 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:24:51.190501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:51.191314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:51.198806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.199349 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.200447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.200958 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.426662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.435766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-65296137-c731-49cc-b881-56375f92de1d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.835479 Jul 20 19:24:51.442656 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 63/133] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:50 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:51.498569 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.510836 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.516318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:51.520651 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f12b00ec-820a-4358-af18-e963e2198c32 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1600 microversion: 2.20 time: 0.333462 Jul 20 19:24:51.522379 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 71/134] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:24:51 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1600 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:24:51.547615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:51.548122 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:51.562286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.562740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.563516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:51.563950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:51.673403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-30c29991-e2d9-43f1-a578-b3071fb2823b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130503 Jul 20 19:24:51.674767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 64/135] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jul 20 19:24:51 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:24:52.168821 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b594619b-1115-43d3-a79a-9ad91a02fee6"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:52.170157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.181707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.182359 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.183288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.183875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.193098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:52.194828 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.207970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.209724 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.211365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.212557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.468490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:52.476766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d5606ec0-57bc-4a19-8064-cd8e5fce99bc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1548 microversion: 2.1 time: 0.287527 Jul 20 19:24:52.478717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 65/136] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:52 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1548 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:52.483581 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:52.484455 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.491881 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.492460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.493303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.493879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.511066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.771899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:52.781976 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9dc5d01b-ef43-449b-86e6-afb27d51a4b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.301649 Jul 20 19:24:52.786027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 66/137] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:52 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:52.795208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:52.795795 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:52.813569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.816643 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.817139 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.818022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:52.819807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:52.891427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4ec36be1-9e90-4c4a-94aa-13d868fc766d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "POST /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.726066 Jul 20 19:24:52.894364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 72/138] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:24:52 2022] POST /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e/os-volume_attachments => generated 194 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:52.935903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c3b53575-08e1-423c-ab03-4791b83f95d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148185 Jul 20 19:24:52.936671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 67/139] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:24:52 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:53.804506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:53.805217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:53.819204 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.819663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:53.820487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:53.820933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.019244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-63b87149-5934-4839-84f0-dec982677062 req-38aa1549-465b-4642-8232-528823c92d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:54.042803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-63b87149-5934-4839-84f0-dec982677062 req-38aa1549-465b-4642-8232-528823c92d3e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:54.043253 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-63b87149-5934-4839-84f0-dec982677062 req-38aa1549-465b-4642-8232-528823c92d3e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:54.083477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-63b87149-5934-4839-84f0-dec982677062 req-38aa1549-465b-4642-8232-528823c92d3e service nova] Creating event network-changed:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:24:54.098050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-63b87149-5934-4839-84f0-dec982677062 req-38aa1549-465b-4642-8232-528823c92d3e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079742 Jul 20 19:24:54.101178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 68/140] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:24:54.341209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:54.352461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-89db2521-b153-4042-b50d-14856e88ff27 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.553436 Jul 20 19:24:54.355576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 73/141] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:53 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:55.195032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-24fc5b86-23c5-451c-b09d-30e64176a991 req-6c7da7ec-a5be-4b75-91a1-40e34e481780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f977b5-705c-46e5-b597-311c97d2edea", "tag": "a8824afd-c0c0-48f6-a2ee-5085bf6628cf"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:24:55.214613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-24fc5b86-23c5-451c-b09d-30e64176a991 req-6c7da7ec-a5be-4b75-91a1-40e34e481780 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.215061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-24fc5b86-23c5-451c-b09d-30e64176a991 req-6c7da7ec-a5be-4b75-91a1-40e34e481780 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.255311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-24fc5b86-23c5-451c-b09d-30e64176a991 req-6c7da7ec-a5be-4b75-91a1-40e34e481780 service nova] Creating event network-changed:a8824afd-c0c0-48f6-a2ee-5085bf6628cf for instance 58f977b5-705c-46e5-b597-311c97d2edea on hv-cinder-81914 Jul 20 19:24:55.276157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-24fc5b86-23c5-451c-b09d-30e64176a991 req-6c7da7ec-a5be-4b75-91a1-40e34e481780 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086668 Jul 20 19:24:55.277301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 69/142] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:24:55.372135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:55.372765 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:55.393421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.393879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:55.395898 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:55.404769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:56.099892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:56.116953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4740f295-c551-4d49-ac20-eb57c180c770 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.745472 Jul 20 19:24:56.120212 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:55 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:57.136136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:57.136884 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:57.148126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:57.148536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:57.149320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:57.149757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:57.400383 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:57.410314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-da942d63-01dc-49e7-a68c-f2656336f749 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.278252 Jul 20 19:24:57.415280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:57 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:58.430277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:58.431696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:58.443465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.443922 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.444729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:58.445168 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:58.639231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:58.648588 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-187d3b3e-ab3b-4244-b744-c60ddedde1fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.224591 Jul 20 19:24:58.649694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 75/145] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:58 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:24:59.666645 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:24:59.667530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:24:59.674928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.675669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.676731 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:24:59.677907 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:24:59.872319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:24:59.887490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2ee97dec-5ae5-4018-820b-9c9e8f165334 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.225610 Jul 20 19:24:59.888069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 71/146] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:24:59 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:00.905673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:00.906378 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:00.925703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.929700 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.931022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:00.934090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:00.950857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:01.168950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:01.179695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8ac64682-14f7-427f-9be3-e2eb6a3e75fe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.277919 Jul 20 19:25:01.181012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 76/147] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:00 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:01.852537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:01.853243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:01.864042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.864530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.869999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:01.870574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:01.926447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:25:02.095004 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b7f80133-649f-4432-aa7c-e0ae79a1a4de tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 204 len: 0 microversion: 2.1 time: 0.246642 Jul 20 19:25:02.096710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 72/148] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:01 2022] DELETE /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:25:02.106086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:02.106834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:02.118056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.118818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.122920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.123475 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.199565 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:02.200822 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:02.212446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.214195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.215990 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:02.217760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:02.325283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:02.335239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2361d0be-163f-419b-a1ee-e444c7c35ea4 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1554 microversion: 2.1 time: 0.233632 Jul 20 19:25:02.336433 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 77/149] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:02 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:02.493847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:02.513307 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-84e108ec-77ff-4d98-a3f5-3c3b4b39b989 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.316644 Jul 20 19:25:02.516987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 73/150] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:02 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:03.352233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:03.352896 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:03.376496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.376949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.377736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.378171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.534320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:03.537226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:03.544742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.545592 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.546963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:03.547596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:03.590542 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:03.616282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4d69f550-ea2a-4ced-98b9-7f2f3e77e6d0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1554 microversion: 2.1 time: 0.268326 Jul 20 19:25:03.625952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 78/151] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:03 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:03.847092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:03.857743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5d55a420-2b6b-4bea-8f30-c87e5cc0e90e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.328419 Jul 20 19:25:03.859388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 74/152] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:03 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:04.636245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:04.638022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:04.659475 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.660116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.661153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.661796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.879163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:04.879867 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:04.892663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.894476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:04.897912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:04.900176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.091990 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:05.110492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4a939a89-ae14-42eb-8dc2-586d275f9dd0 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1554 microversion: 2.1 time: 0.478630 Jul 20 19:25:05.112216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 79/153] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:04 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1554 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:05.320057 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:05.330909 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-81585884-c766-4e43-8558-5567dd509a04 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.458084 Jul 20 19:25:05.343825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 75/154] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:04 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:05.585903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-c1c0f8f1-ff8d-4b39-a95f-e47404236a60 req-d5892089-4f72-4342-8878-43b64e90983d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5754cfb-a037-4363-8936-15978c89549e", "name": "network-vif-deleted", "tag": "d1b2ec4f-4809-4219-9acc-9861fab9de05"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:05.613052 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-c1c0f8f1-ff8d-4b39-a95f-e47404236a60 req-d5892089-4f72-4342-8878-43b64e90983d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:05.615816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-c1c0f8f1-ff8d-4b39-a95f-e47404236a60 req-d5892089-4f72-4342-8878-43b64e90983d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:05.641274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-c1c0f8f1-ff8d-4b39-a95f-e47404236a60 req-d5892089-4f72-4342-8878-43b64e90983d service nova] Creating event network-vif-deleted:d1b2ec4f-4809-4219-9acc-9861fab9de05 for instance e5754cfb-a037-4363-8936-15978c89549e on hv-cinder-81914 Jul 20 19:25:05.649355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-c1c0f8f1-ff8d-4b39-a95f-e47404236a60 req-d5892089-4f72-4342-8878-43b64e90983d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071602 Jul 20 19:25:05.650138 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 80/155] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:06.129759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:06.130447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:06.141928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.142974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.145311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.147242 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.220354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.223297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.224922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lazy-loading 'fault' on Instance uuid e5754cfb-a037-4363-8936-15978c89549e {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:06.352244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:06.353442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:06.367943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.368552 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.369553 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:06.370067 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:06.595977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:06.606742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0284484e-381e-44f5-98d4-524d546d8330 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.260265 Jul 20 19:25:06.608893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 81/156] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:06 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:06.705177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b7b1014c466482b95820616b54dd13a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5231dfdf49c44f7ab191159ea563dad7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:06.713910 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b95f631e-ad8d-44ae-b703-5aca5b13f78b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 200 len: 1351 microversion: 2.1 time: 0.588655 Jul 20 19:25:06.726065 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 76/157] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:06 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 1351 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:07.628225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:07.629848 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:07.636079 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.637068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.638277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.638752 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.734005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:07.735261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:07.760135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.760816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.762280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:07.767203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:07.786412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] HTTP exception thrown: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Request method failure captured: Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e HTTP/1.1 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZR_Yk9aNBy-C3Tgu9QeIILzpv_wvaQggkCYZaqHVYLuvLisrIQaVaLEb4XjSyHrY5_D1cKyCNPenyViPK-9kkPGYhRJ1jfW0TjPqWGTDjJFT3qnQ0QOxz5Kd0iJzdVIG-bjquwOQUOHirPIFaLPAo0yAjHzGxpvzZeHivG6n6lrJo Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:07.793001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5231dfdf49c44f7ab191159ea563dad7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}] Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3b7b1014c466482b95820616b54dd13a Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:07.794575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'e5754cfb-a037-4363-8936-15978c89549e'} Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:07.795302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:07.796633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:07.799517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Returning 404 to user: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:07.800975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-24d79365-5e7d-4a4b-8be1-efdd0d2484d8 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 404 len: 111 microversion: 2.1 time: 0.073070 Jul 20 19:25:07.806640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 77/158] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:07 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:08.043928 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:08.073042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9de47837-caf4-4b32-90ef-fdb9585154de tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.450943 Jul 20 19:25:08.077459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 82/159] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:07 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:08.127799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:08.128970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:08.157301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.157755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.158540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:08.158976 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:08.217537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] HTTP exception thrown: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Request method failure captured: Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e/os-volume_attachments HTTP/1.1 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZR_Yk9aNBy-C3Tgu9QeIILzpv_wvaQggkCYZaqHVYLuvLisrIQaVaLEb4XjSyHrY5_D1cKyCNPenyViPK-9kkPGYhRJ1jfW0TjPqWGTDjJFT3qnQ0QOxz5Kd0iJzdVIG-bjquwOQUOHirPIFaLPAo0yAjHzGxpvzZeHivG6n6lrJo Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:08.225171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5231dfdf49c44f7ab191159ea563dad7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}] Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3b7b1014c466482b95820616b54dd13a Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:08.226535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'server_id': 'e5754cfb-a037-4363-8936-15978c89549e'} Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:08.227864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:08.231568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:08.232676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Returning 404 to user: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:08.232676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cd83ded0-fb7f-4193-9afe-3885a50ce92d tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.103111 Jul 20 19:25:08.232676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 78/160] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:25:08 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e/os-volume_attachments => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:09.094206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:09.094811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:09.102328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.104838 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.107020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.107626 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.592803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:09.593965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:09.608888 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.609868 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.611264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.612127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.634360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] HTTP exception thrown: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Request method failure captured: Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e HTTP/1.1 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZR_Yk9aNBy-C3Tgu9QeIILzpv_wvaQggkCYZaqHVYLuvLisrIQaVaLEb4XjSyHrY5_D1cKyCNPenyViPK-9kkPGYhRJ1jfW0TjPqWGTDjJFT3qnQ0QOxz5Kd0iJzdVIG-bjquwOQUOHirPIFaLPAo0yAjHzGxpvzZeHivG6n6lrJo Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:09.637020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5231dfdf49c44f7ab191159ea563dad7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}] Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3b7b1014c466482b95820616b54dd13a Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.638227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'e5754cfb-a037-4363-8936-15978c89549e'} Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:09.638877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.639915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.645336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Returning 404 to user: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:09.646568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1cc715bc-4250-48d3-ad86-cdcc66306a68 tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 404 len: 111 microversion: 2.1 time: 0.059904 Jul 20 19:25:09.647810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 79/161] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:09 2022] DELETE /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:09.665555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:09.668843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] [instance: e5754cfb-a037-4363-8936-15978c89549e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:09.685946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.688652 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.690947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:09.693895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:09.731664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] HTTP exception thrown: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Request method failure captured: Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e HTTP/1.1 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZR_Yk9aNBy-C3Tgu9QeIILzpv_wvaQggkCYZaqHVYLuvLisrIQaVaLEb4XjSyHrY5_D1cKyCNPenyViPK-9kkPGYhRJ1jfW0TjPqWGTDjJFT3qnQ0QOxz5Kd0iJzdVIG-bjquwOQUOHirPIFaLPAo0yAjHzGxpvzZeHivG6n6lrJo Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:09.737593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5231dfdf49c44f7ab191159ea563dad7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5231dfdf49c44f7ab191159ea563dad7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5231dfdf49c44f7ab191159ea563dad7"}]}] Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 5231dfdf49c44f7ab191159ea563dad7 Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-DeleteServersTestJSON-1321869711 Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3b7b1014c466482b95820616b54dd13a Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-DeleteServersTestJSON-1321869711-project Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.739008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'e5754cfb-a037-4363-8936-15978c89549e'} Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:09.740354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. Jul 20 19:25:09.741642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:09.742807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] Returning 404 to user: Instance e5754cfb-a037-4363-8936-15978c89549e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:09.744885 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4e239c9f-3a05-4a5f-9624-ae65654df09b tempest-DeleteServersTestJSON-1321869711 tempest-DeleteServersTestJSON-1321869711-project] 10.222.0.43 "GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e" status: 404 len: 111 microversion: 2.1 time: 0.092808 Jul 20 19:25:09.747131 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 80/162] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:09 2022] GET /compute/v2.1/servers/e5754cfb-a037-4363-8936-15978c89549e => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:10.187355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:10.197386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f52db427-4ae5-4086-98d1-0a8e82fe5208 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 1.107398 Jul 20 19:25:10.205671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 83/163] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:09 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:11.230672 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:11.233386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:11.243803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.245000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:11.247058 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:11.248066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:12.183833 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:12.198666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c2a47b0d-ae22-4aa4-81e6-dcdfbe97827b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.972385 Jul 20 19:25:12.200352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 81/164] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:11 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:13.223364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:13.223964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:13.231372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:13.232141 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:13.233001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:13.233548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:13.262631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1549650619", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "networks": [{"uuid": "9535d651-697b-4106-9328-f6db4818fc11"}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:13.338277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] validate_networks() for [('9535d651-697b-4106-9328-f6db4818fc11', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:25:13.416143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:13.426663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-936419fe-b23f-40ec-8cf3-2a0c7ad34a1e tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.213274 Jul 20 19:25:13.428203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 84/165] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:13 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:14.487594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:25:14.488934 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:25:14.489446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:25:14.490181 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:25:14.490589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:25:14.503388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.504092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:14.505109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.505722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:14.533155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Getting quotas for project aba8221c6e144e94ae026555d5317576. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:14.538927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Getting quotas for user 83ba05eb66ec44598ec0809cfc0c4ccd and project aba8221c6e144e94ae026555d5317576. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:14.556505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:25:14.559487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:25:14.628865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-57a2498f-6de1-44a3-a497-0bc9f6d938b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371087 Jul 20 19:25:14.629624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-52f61182-54af-41ec-9aaa-5284a3322ebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Action: 'create', calling method: .version_select at 0x7f26c19249d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1218028535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlUgOQA70nyVb0K+a96O6wuFXW5wQBt5aXVAoxR8jmJvlz49MTqF9/JicD24JscWhSbWUA2obFVrcmE3Q+eR/s0i8bNH53v74NfuhncQmSqAfBfZlb8wasCqii88eMOng=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:14.635354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 82/166] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:25:14.641071 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:14.642034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:14.647368 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-52f61182-54af-41ec-9aaa-5284a3322ebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for project 182d5b6ac9e6412b907119a623869c80. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:14.650253 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.650799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:14.651861 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:14.651976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-52f61182-54af-41ec-9aaa-5284a3322ebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for user 4a4f4d585adf40b880be44c29ecd53cd and project 182d5b6ac9e6412b907119a623869c80. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:14.652665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:14.689351 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-52f61182-54af-41ec-9aaa-5284a3322ebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.292864 Jul 20 19:25:14.693344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 85/167] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:25:14 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:14.701765 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bea1b5d5-aa17-4c67-9ec6-3c00e4345f2b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:14.702145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bea1b5d5-aa17-4c67-9ec6-3c00e4345f2b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:14.993420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bea1b5d5-aa17-4c67-9ec6-3c00e4345f2b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:15.002540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bea1b5d5-aa17-4c67-9ec6-3c00e4345f2b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1214 microversion: 2.1 time: 0.307870 Jul 20 19:25:15.014275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 86/168] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:14 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:15.343279 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:15.358578 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b1b8a82b-317c-4451-ba81-6bd6c0edd8b4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.721488 Jul 20 19:25:15.359161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 83/169] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:14 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:16.026271 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:16.026859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:16.054889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.055357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.056158 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.056682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.187425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:16.212726 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-23fca940-2c71-4aea-95bc-b2cea4f1c57b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1266 microversion: 2.1 time: 0.181558 Jul 20 19:25:16.215073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 87/170] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:16 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:16.376599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:16.377916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:16.390553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.394129 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.395509 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:16.401496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:16.905361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:16.920340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-345c73a1-e63c-4c81-8258-73548c2c40a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.549163 Jul 20 19:25:16.920968 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 84/171] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:16 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:17.231308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:17.232670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:17.257361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:17.257831 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:17.262178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:17.268339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:17.474405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:17.485195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e9e7ab08-fb37-4108-be3c-8d7fed668bbd tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1272 microversion: 2.1 time: 0.256256 Jul 20 19:25:17.486125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 88/172] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:17 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:17.950031 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:17.952221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:17.999347 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:17.999798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.000903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:18.002423 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.291865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:18.301297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3fb0a9f3-9232-4187-9b3b-04254b389fa6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.367040 Jul 20 19:25:18.301939 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 85/173] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:17 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:18.505554 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:18.506173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:18.527959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:18.528465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.529255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:18.529696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:18.832223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:18.844230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0189c2fb-f419-4356-ba96-308359df2e47 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.342779 Jul 20 19:25:18.853665 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 89/174] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:18 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:19.320211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:19.326399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:19.336408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.336867 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.337718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.338156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.347297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.512940 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:19.523223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-67ec25f8-48f1-415a-bd6f-830079782d6d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.208469 Jul 20 19:25:19.532631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 86/175] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:19 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:19.852360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-bdff22cd-d632-4b07-9164-f3287d08733e req-23b7db20-64ae-4fcb-9a7e-f1edf8f5a89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13233e67-291b-405c-a535-9c259d66c96f", "tag": "3f38ca78-3228-49a5-93fd-0c1d690c2734"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:19.860446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.863471 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:19.865127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:19.873132 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-bdff22cd-d632-4b07-9164-f3287d08733e req-23b7db20-64ae-4fcb-9a7e-f1edf8f5a89b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.873808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-bdff22cd-d632-4b07-9164-f3287d08733e req-23b7db20-64ae-4fcb-9a7e-f1edf8f5a89b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.886296 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.886982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.887228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-bdff22cd-d632-4b07-9164-f3287d08733e req-23b7db20-64ae-4fcb-9a7e-f1edf8f5a89b service nova] Creating event network-changed:3f38ca78-3228-49a5-93fd-0c1d690c2734 for instance 13233e67-291b-405c-a535-9c259d66c96f on hv-cinder-81914 Jul 20 19:25:19.888036 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:19.888558 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:19.895701 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-bdff22cd-d632-4b07-9164-f3287d08733e req-23b7db20-64ae-4fcb-9a7e-f1edf8f5a89b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045183 Jul 20 19:25:19.896869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 90/176] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:20.043385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:20.051292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ddcb4486-361a-47a8-84a3-f527d0f5dc8a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.193143 Jul 20 19:25:20.052992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 87/177] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:19 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:20.344863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5a973faf-04e1-4201-9e12-a79336f7c9d9 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Action: 'create', calling method: .version_select at 0x7f26c1846700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881839317", "metadata": {"Type": "work"}}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5a973faf-04e1-4201-9e12-a79336f7c9d9 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 122 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:25:20.371466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1881839317", "metadata": {"Type": "work"}}} Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:25:20.372911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1881839317', 'metadata': {'Type': 'work'}}}} Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.373640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:25:20.375760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:25:20.378068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 19:25:20.378068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.378068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5a973faf-04e1-4201-9e12-a79336f7c9d9 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.378068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5a973faf-04e1-4201-9e12-a79336f7c9d9 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.174626 Jul 20 19:25:20.378068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 91/178] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 19:25:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:25:20.383616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8ce8e345-3d5b-46a7-8135-863c2e4d306a tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Action: 'create', calling method: .version_select at 0x7f26c1798160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1641403974", "metadata": {"Type": "work"}}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8ce8e345-3d5b-46a7-8135-863c2e4d306a tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 120 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:20.387050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1641403974", "metadata": {"Type": "work"}}} Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: Jul 20 19:25:20.388460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1641403974', 'metadata': {'Type': 'work'}}}} Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi '0' Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.389305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:25:20.390895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:25:20.391970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 19:25:20.391970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.391970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8ce8e345-3d5b-46a7-8135-863c2e4d306a tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.391970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8ce8e345-3d5b-46a7-8135-863c2e4d306a tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009103 Jul 20 19:25:20.391970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 88/179] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 19:25:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 19:25:20.399890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d3e47ccc-2e52-48aa-acba-f528dc530b97 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Action: 'create', calling method: .version_select at 0x7f26c1924b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-836560276", "metadata": {"Type": "work"}}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d3e47ccc-2e52-48aa-acba-f528dc530b97 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 118 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:25:20.402719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-836560276", "metadata": {"Type": "work"}}} Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:25:20.403961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-836560276', 'metadata': {'Type': 'work'}}}} Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise error Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi '' Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.404695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 19:25:20.406118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 19:25:20.407119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 19:25:20.407119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.407119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d3e47ccc-2e52-48aa-acba-f528dc530b97 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.407119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d3e47ccc-2e52-48aa-acba-f528dc530b97 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009544 Jul 20 19:25:20.409169 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 92/180] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 19:25:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:25:20.414938 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ef4a413d-96b1-41f9-b5f9-28c5921a5a27 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Calling method '.version_select at 0x7f26c173f160>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.477541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-ef4a413d-96b1-41f9-b5f9-28c5921a5a27 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] HTTP exception thrown: Volume tempest-invalid-1876705399 could not be found. Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ef4a413d-96b1-41f9-b5f9-28c5921a5a27 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1876705399 HTTP/1.1 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:25:20.481186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Volume tempest-invalid-1876705399 could not be found. Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'tempest-invalid-1876705399'} Jul 20 19:25:20.482595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1876705399 could not be found. (HTTP 404) (Request-ID: req-97f85878-2133-4721-abcd-c9a71068fb18) Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.483288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:25:20.484345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1876705399 could not be found. Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:20.485839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1876705399 could not be found. Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1876705399 could not be found. Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ef4a413d-96b1-41f9-b5f9-28c5921a5a27 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 404 to user: Volume tempest-invalid-1876705399 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ef4a413d-96b1-41f9-b5f9-28c5921a5a27 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1876705399" status: 404 len: 99 microversion: 2.1 time: 0.073675 Jul 20 19:25:20.487161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 89/181] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 19:25:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1876705399 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 19:25:20.494294 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2bf42370-650d-4958-9192-b0c49ef87bac tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003770 Jul 20 19:25:20.494798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 93/182] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jul 20 19:25:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 19:25:20.503647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e3c73c92-bf23-474d-84b2-101a1bd0ac30 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004033 Jul 20 19:25:20.504149 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 90/183] 10.222.0.43 () {58 vars in 1136 bytes} [Wed Jul 20 19:25:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 19:25:20.512747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-160b120a-1cde-4f3f-ba16-7329bafbba49 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Calling method '.version_select at 0x7f26c1846700>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.541569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.542295 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:20.542703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-160b120a-1cde-4f3f-ba16-7329bafbba49 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] HTTP exception thrown: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-160b120a-1cde-4f3f-ba16-7329bafbba49 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/os-volumes/74e9d087-6be7-4fc0-a563-5967e8c822ed HTTP/1.1 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:25:20.546682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '74e9d087-6be7-4fc0-a563-5967e8c822ed'} Jul 20 19:25:20.547881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. (HTTP 404) (Request-ID: req-a18396fa-6424-4fbf-b65a-b48edb67a0c3) Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.548696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:25:20.549863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:25:20.551179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-160b120a-1cde-4f3f-ba16-7329bafbba49 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 404 to user: Volume 74e9d087-6be7-4fc0-a563-5967e8c822ed could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-160b120a-1cde-4f3f-ba16-7329bafbba49 tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/74e9d087-6be7-4fc0-a563-5967e8c822ed" status: 404 len: 109 microversion: 2.1 time: 0.039115 Jul 20 19:25:20.552564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 94/184] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:25:20 2022] DELETE /compute/v2.1/os-volumes/74e9d087-6be7-4fc0-a563-5967e8c822ed => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:20.553671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.553671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.553671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:20.553671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:20.562778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6c018682-9d72-4620-80e7-c2f9864fc68c tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Calling method '.version_select at 0x7f26c18944c0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:20.592157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-6c018682-9d72-4620-80e7-c2f9864fc68c tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] HTTP exception thrown: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6c018682-9d72-4620-80e7-c2f9864fc68c tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Request method failure captured: Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/os-volumes/ccd2e72e-705d-4851-bc72-5a822426449e HTTP/1.1 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FagrfNGwyBZkeDcUn5EZauENo1HE1Ed3CIkG7gL-GSZLzHw16KcSr5fBLB_bLUPRW20rKko9Cu5BmpvSd4tMr8sFzJSTyIVeywt9AU5GUkzAJPN_N436v1prPMjfgtuZBsw8nm-ux813uBEZWlkA0UpOmDQmi9JzSB4nhUe91tB9yM Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:25:20.594152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1bf20f7d2ff04565a0c06ebf8de59e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1bf20f7d2ff04565a0c06ebf8de59e38", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1bf20f7d2ff04565a0c06ebf8de59e38"}]}] Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 1bf20f7d2ff04565a0c06ebf8de59e38 Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesNegativeTest-328775122 Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5941d9e1753f49b4ad16997e7fa4140f Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesNegativeTest-328775122-project Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'ccd2e72e-705d-4851-bc72-5a822426449e'} Jul 20 19:25:20.595669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. (HTTP 404) (Request-ID: req-279df8db-70d1-4188-b750-a131443c9595) Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.596760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:25:20.597912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:25:20.598921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6c018682-9d72-4620-80e7-c2f9864fc68c tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] Returning 404 to user: Volume ccd2e72e-705d-4851-bc72-5a822426449e could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6c018682-9d72-4620-80e7-c2f9864fc68c tempest-VolumesNegativeTest-328775122 tempest-VolumesNegativeTest-328775122-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/ccd2e72e-705d-4851-bc72-5a822426449e" status: 404 len: 109 microversion: 2.1 time: 0.036956 Jul 20 19:25:20.601238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 95/185] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:25:20 2022] GET /compute/v2.1/os-volumes/ccd2e72e-705d-4851-bc72-5a822426449e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:25:20.690772 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:20.699377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b8746d01-3a69-412d-b7bc-dcce894a1c5c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.162802 Jul 20 19:25:20.709852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 91/186] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:20 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:21.069528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:21.070247 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:21.077602 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.078045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.078808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.079238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.271281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:21.281218 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-cd736420-d9a6-45c3-bc7b-fad250b95c04 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.216638 Jul 20 19:25:21.282819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 96/187] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:21 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:21.717840 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:21.719871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:21.727548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.727982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.728967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:21.729396 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:21.886510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:21.894126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2243062c-2c7e-4c03-a750-bff45d46bc8b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.181146 Jul 20 19:25:21.894700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 92/188] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:21 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:22.298425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:22.299562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:22.307540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.307540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.307715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.308077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.449644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:22.458137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-935f23e1-434c-4667-96db-f3b2b184b04d tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.163684 Jul 20 19:25:22.459675 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 97/189] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:22 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:22.913863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:22.915149 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:22.918002 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.926288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.926950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:22.928424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:22.929655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.087089 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:23.096394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6ccf9d84-2c82-4a80-9f46-49e9123ec814 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.188732 Jul 20 19:25:23.097188 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 93/190] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:22 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:23.484318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:23.491571 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:23.498033 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.498480 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.499246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:23.499672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:23.648809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:23.656395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ea9b4057-3ea7-44b1-b090-b216e7d0197c tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.184864 Jul 20 19:25:23.656963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 98/191] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:23 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:24.114336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:24.115681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:24.123172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.123595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.124553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.125014 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.314495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:24.323411 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-10c7c4f3-cb47-41cf-b718-3b8b4170d996 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.213175 Jul 20 19:25:24.330351 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 94/192] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:24 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:24.673395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:24.673995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:24.680809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.682031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.682031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.682453 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.836652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:24.839513 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-1236d96c-e764-4783-a1e5-95424e40135a req-14b8713f-c105-40a6-a52a-6443883c0193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13233e67-291b-405c-a535-9c259d66c96f", "name": "network-vif-plugged", "status": "completed", "tag": "3f38ca78-3228-49a5-93fd-0c1d690c2734"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:24.847223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.848466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.852491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-37a60453-060a-47b3-8b49-f91bbb82750a tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.182069 Jul 20 19:25:24.857302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1236d96c-e764-4783-a1e5-95424e40135a req-14b8713f-c105-40a6-a52a-6443883c0193 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:24.857973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1236d96c-e764-4783-a1e5-95424e40135a req-14b8713f-c105-40a6-a52a-6443883c0193 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:24.863446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 99/193] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:24 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:24.872522 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-1236d96c-e764-4783-a1e5-95424e40135a req-14b8713f-c105-40a6-a52a-6443883c0193 service nova] Creating event network-vif-plugged:3f38ca78-3228-49a5-93fd-0c1d690c2734 for instance 13233e67-291b-405c-a535-9c259d66c96f on hv-cinder-81914 Jul 20 19:25:24.877613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-1236d96c-e764-4783-a1e5-95424e40135a req-14b8713f-c105-40a6-a52a-6443883c0193 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047292 Jul 20 19:25:24.878227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 95/194] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:25.340949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.341547 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:25.344530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:25.350188 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.350679 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.351445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.351876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.499385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:25.507331 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b2f357e9-077f-4005-bfa1-e046318442f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.170731 Jul 20 19:25:25.516634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 100/195] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:25.870844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:25.871521 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:25.877752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.878206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:25.878972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:25.879406 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.024903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:26.032541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-688d9727-613c-486b-811d-94542b26bce9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.165989 Jul 20 19:25:26.033098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 96/196] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:25 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:26.524676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:26.525332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:26.531683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.532126 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.532918 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:26.533347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:26.537926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:26.675620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:26.683452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-768a6e28-2ec7-436d-b957-9a42b3884e84 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.163156 Jul 20 19:25:26.684107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 101/197] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:26 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:27.049472 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:27.050025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:27.055997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.056540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.057367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.057807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.196831 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:27.204730 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e31ddb29-e39b-4a7b-891b-f393e25ed37b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1314 microversion: 2.1 time: 0.159095 Jul 20 19:25:27.205329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 97/198] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:27 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:27.700941 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:27.701607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:27.708118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.709327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.710045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:27.710554 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:27.842871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:27.850405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e078e3df-4d07-4d98-b606-60febcaa7c03 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.153489 Jul 20 19:25:27.850977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 102/199] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:27 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:28.222050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:28.222706 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:28.228794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.229240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.230055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.230554 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.364263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:28.372574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2e8be658-fb37-400b-b93f-5a828166f6fa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1498 microversion: 2.1 time: 0.154336 Jul 20 19:25:28.373148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 98/200] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:28 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:28.865920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:28.867042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:28.867293 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:28.868265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:28.874946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.875390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.875548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.876145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.876524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.877045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.877425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:28.878010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:28.910536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:25:29.048624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d99209d4-6c5d-4064-b44c-8b0bd16d1b28 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "DELETE /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 204 len: 0 microversion: 2.1 time: 0.186066 Jul 20 19:25:29.049227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 103/201] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:28 2022] DELETE /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:25:29.061315 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:29.062702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:29.070461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.070944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.072181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:29.072809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:29.094527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:29.106913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fc57094b-9fba-43bf-9558-f05244205e5a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.243740 Jul 20 19:25:29.107864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:28 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:29.314910 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:29.323001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-71d1c096-c297-4d06-addb-43d5aff642e1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1504 microversion: 2.1 time: 0.268645 Jul 20 19:25:29.323632 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 104/203] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:29 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:30.125037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:30.125893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:30.132456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.133011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.133980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.134329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.279445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:30.287312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-166c0f58-b81b-4f28-b026-ca262ee532f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.166465 Jul 20 19:25:30.288409 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 100/204] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:30 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:30.340972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:30.342170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:30.349573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.350221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.351221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:30.351802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:30.502508 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:30.511930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-92dec0c2-a1e8-46ea-90cb-e6dbb77708b4 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1504 microversion: 2.1 time: 0.175316 Jul 20 19:25:30.513062 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 105/205] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:30 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:31.305023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:31.305626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:31.312669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.313320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.314074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.314675 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.472669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:31.482385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9d76988a-e601-4f05-aa81-aba92ef32a32 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1522 microversion: 2.1 time: 0.181401 Jul 20 19:25:31.483328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 101/206] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:31 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:31.530672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:31.531907 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:31.539124 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.539570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.540365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.540949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.774939 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:31.788442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1225b5c8-7287-4407-bab9-35cfb7bc6b97 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 200 len: 1504 microversion: 2.1 time: 0.262298 Jul 20 19:25:31.790202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 106/207] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:31 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:31.836914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-42e02488-dc7c-4674-a1c7-3d86ba45050d req-87209122-42a8-42f3-8c1f-c4edb7a0326c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13233e67-291b-405c-a535-9c259d66c96f", "name": "network-vif-deleted", "tag": "3f38ca78-3228-49a5-93fd-0c1d690c2734"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:31.847349 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-42e02488-dc7c-4674-a1c7-3d86ba45050d req-87209122-42a8-42f3-8c1f-c4edb7a0326c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:31.847623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-42e02488-dc7c-4674-a1c7-3d86ba45050d req-87209122-42a8-42f3-8c1f-c4edb7a0326c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:31.860593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-42e02488-dc7c-4674-a1c7-3d86ba45050d req-87209122-42a8-42f3-8c1f-c4edb7a0326c service nova] Creating event network-vif-deleted:3f38ca78-3228-49a5-93fd-0c1d690c2734 for instance 13233e67-291b-405c-a535-9c259d66c96f on hv-cinder-81914 Jul 20 19:25:31.874221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-42e02488-dc7c-4674-a1c7-3d86ba45050d req-87209122-42a8-42f3-8c1f-c4edb7a0326c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040931 Jul 20 19:25:31.878088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 102/208] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:32.503305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.514044 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.522387 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.522826 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.523914 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.524806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.666124 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:32.675072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-60d7363a-d2d3-4425-813f-fa5ff86baabe tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1502 microversion: 2.1 time: 0.179940 Jul 20 19:25:32.675635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 107/209] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:32.694748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.695310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.701930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.703467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.704317 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.704765 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.806156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:32.806761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 13233e67-291b-405c-a535-9c259d66c96f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:32.813131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.813512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.814274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:32.814911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:32.834108 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] HTTP exception thrown: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Request method failure captured: Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f HTTP/1.1 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FaXZ0L9cCmH0w7sClrcd_FnbNkLue9S1EhnFEET_uIr-55X7c1gtCisriwClTxHZTFQqFVGUr15aUuwkwJBvgz5N8XGauR6rqXVexA98oHjhaDj_VUOqYhMzt884_kRYRIN3OT0oXZTonJDaV2kwDlFjsj19gy_kCPqPJ2yepv5Opc Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: aba8221c6e144e94ae026555d5317576 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesActionsTest-1332622078 Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:25:32.839195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aba8221c6e144e94ae026555d5317576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aba8221c6e144e94ae026555d5317576"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aba8221c6e144e94ae026555d5317576", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aba8221c6e144e94ae026555d5317576"}]}] Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesActionsTest-1332622078 Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: aba8221c6e144e94ae026555d5317576 Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesActionsTest-1332622078 Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesActionsTest-1332622078-project Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 83ba05eb66ec44598ec0809cfc0c4ccd Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesActionsTest-1332622078-project Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. Jul 20 19:25:32.840808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '13233e67-291b-405c-a535-9c259d66c96f'} Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:25:32.841699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. Jul 20 19:25:32.842855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:25:32.844173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Returning 404 to user: Instance 13233e67-291b-405c-a535-9c259d66c96f could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:25:32.844173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-94638025-df25-4a3a-914f-7cc8337a2cb3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f" status: 404 len: 111 microversion: 2.1 time: 0.039356 Jul 20 19:25:32.844173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 108/210] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/13233e67-291b-405c-a535-9c259d66c96f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:25:32.856209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:32.864960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-55d38c34-1a47-4c22-9da6-77229a233b36 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1515 microversion: 2.1 time: 0.176133 Jul 20 19:25:32.866371 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 103/211] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:32 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:32.972088 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-531538197", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "networks": [{"uuid": "9535d651-697b-4106-9328-f6db4818fc11"}]}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:33.034366 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] validate_networks() for [('9535d651-697b-4106-9328-f6db4818fc11', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:25:33.513530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:25:33.514502 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:25:33.515314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:25:33.515864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:25:33.516438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:25:33.526387 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.526877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.527828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:33.528468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:33.551966 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Getting quotas for project aba8221c6e144e94ae026555d5317576. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:33.556179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Getting quotas for user 83ba05eb66ec44598ec0809cfc0c4ccd and project aba8221c6e144e94ae026555d5317576. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:33.573932 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:25:33.576314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:25:33.627858 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0040c12d-06cb-48cd-bdf1-45866c27f9bb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660236 Jul 20 19:25:33.634096 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 109/212] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:25:33.640541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd75f431-5cd8-4ac8-be53-c21013464dff tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:33.641559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cd75f431-5cd8-4ac8-be53-c21013464dff tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:33.716233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cd75f431-5cd8-4ac8-be53-c21013464dff tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:33.723385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cd75f431-5cd8-4ac8-be53-c21013464dff tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1213 microversion: 2.1 time: 0.087469 Jul 20 19:25:33.723997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 104/213] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:33 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:34.278676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:34.279603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:34.286438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.287432 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.288216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.288694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.312122 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'flavor' on Instance uuid 057f48c6-98d1-43fb-ab77-526c7ff0cf07 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:34.560024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-043119d7-34bd-4379-bf36-6a810a7a1e2a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/action" status: 200 len: 32 microversion: 2.1 time: 0.285400 Jul 20 19:25:34.560672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 110/214] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:25:34 2022] POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:25:34.570447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.571184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:34.578321 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.578945 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.579985 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.580715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.729363 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:34.736942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-eb0af95e-141a-488d-8199-3881bd34dc55 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.170783 Jul 20 19:25:34.737687 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 105/215] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:34.743163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:34.743856 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:34.750722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.751225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.751996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:34.752506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:34.817246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:34.825749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d7fecd5d-092b-44d4-949d-0c8a71727f23 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1209 microversion: 2.1 time: 0.088461 Jul 20 19:25:34.826334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 111/216] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:34 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:35.754274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:35.754877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:35.761237 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.761682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.762446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.762877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.843381 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:35.843984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:35.850679 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.851130 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.851903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:35.852372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:35.918022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:35.923875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:35.926780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-97b0a704-d5e7-4899-a21c-669b5f19206e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1209 microversion: 2.1 time: 0.087774 Jul 20 19:25:35.927609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 112/217] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:35 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:35.936168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-56b93c9d-e81f-4830-bb15-1653d137863a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.181661 Jul 20 19:25:35.936168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 106/218] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:35 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:36.943153 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:36.943810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:36.949333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:36.950072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.950209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:36.950521 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.951287 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.951725 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.957928 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.959855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:36.960899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:36.961942 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:37.126022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:37.134082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7b21f324-969a-4a20-8672-83ee0b9606aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.188200 Jul 20 19:25:37.137601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 113/219] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:36 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:37.161148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:37.171828 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-efbfc9b3-9aa8-408d-8de0-9b4086ff06d3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1209 microversion: 2.1 time: 0.232539 Jul 20 19:25:37.176762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 107/220] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:36 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1209 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:38.154059 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:38.155350 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:38.163988 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.164491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.165373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.165720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.189474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:38.191135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:38.197857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.198716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.199728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:38.200521 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:38.207484 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:38.390571 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:38.395326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:38.403126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-34e9ca73-1106-4e5f-a197-9f6b973a7b67 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1271 microversion: 2.1 time: 0.217521 Jul 20 19:25:38.403715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 108/221] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:38 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:38.406258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8c4f74ce-8d5a-47c6-9340-2a393149d91c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.258798 Jul 20 19:25:38.407515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 114/222] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:38 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:39.415091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-63317a58-4498-462d-a59c-835887df6c14 req-353f4273-e656-452e-9228-2bdb4c94a080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be1830e-3311-4a0d-bb66-ea396b0e20b2", "tag": "0f7ad1d9-e396-4d19-afee-ff1d009c6716"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:39.422033 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:39.422652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:39.430225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.430670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.431621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.432213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.451208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-63317a58-4498-462d-a59c-835887df6c14 req-353f4273-e656-452e-9228-2bdb4c94a080 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.453010 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-63317a58-4498-462d-a59c-835887df6c14 req-353f4273-e656-452e-9228-2bdb4c94a080 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.454549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.495900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-63317a58-4498-462d-a59c-835887df6c14 req-353f4273-e656-452e-9228-2bdb4c94a080 service nova] Creating event network-changed:0f7ad1d9-e396-4d19-afee-ff1d009c6716 for instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 on hv-cinder-81914 Jul 20 19:25:39.505192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-63317a58-4498-462d-a59c-835887df6c14 req-353f4273-e656-452e-9228-2bdb4c94a080 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096372 Jul 20 19:25:39.506393 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 109/223] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:39.521682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:39.523187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:39.536930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.540072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.541717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:39.542621 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:39.589084 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:39.597241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bcfd0422-72e5-4e94-b82c-07402d123df3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.179884 Jul 20 19:25:39.597894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 115/224] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:39 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:39.604622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1026898303", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1218028535", "security_groups": [{"name": "tempest-secgroup-smoke-1429967910"}], "block_device_mapping_v2": [{"uuid": "9d30f604-6a7b-4c1a-9d8d-124718df0b21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "667371d0-bd3e-4fe0-a41c-e04f1b0a0f03"}]}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:39.726054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] validate_networks() for [('667371d0-bd3e-4fe0-a41c-e04f1b0a0f03', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:25:40.084044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:40.094161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ed8a8ce5-2f00-493c-8057-79659343efd7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.584574 Jul 20 19:25:40.112087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 110/225] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:39 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:40.190072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:25:40.190515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:25:40.190971 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:25:40.191372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:25:40.191915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:25:40.200805 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.201250 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.202083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.202520 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.219864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:25:40.223904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for user 4a4f4d585adf40b880be44c29ecd53cd and project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:25:40.284056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:25:40.286254 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d30f604-6a7b-4c1a-9d8d-124718df0b21',volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:25:40.423881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-45391842-3b45-451b-a7e2-15da3abdf86f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822847 Jul 20 19:25:40.424883 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 116/226] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:25:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:25:40.434654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-171b24c9-78ea-4320-8551-c654af5bfe42 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:40.435483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-171b24c9-78ea-4320-8551-c654af5bfe42 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:40.493484 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-171b24c9-78ea-4320-8551-c654af5bfe42 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:40.500905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-171b24c9-78ea-4320-8551-c654af5bfe42 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1095 microversion: 2.1 time: 0.070045 Jul 20 19:25:40.501488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 111/227] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:40 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:40.614097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:40.614859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:40.622609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.623098 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.623884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:40.624355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:40.760114 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:40.768283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c12d0ea2-b44e-4953-a54a-9c804f42c83e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.158300 Jul 20 19:25:40.769681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 117/228] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:40 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.119776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.120449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:41.127847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.128467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.129370 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.129843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.285490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:41.295258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7d18c991-50fe-4513-97c1-c0bbe31bc9b1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.180020 Jul 20 19:25:41.295834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 112/229] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.520223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.520877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:41.528132 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.528613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.529393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.530015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.616045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:41.625656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1355cce6-36f3-4317-b537-feb01dde8c04 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1137 microversion: 2.1 time: 0.109961 Jul 20 19:25:41.626526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 118/230] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1137 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:41.786039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:41.787267 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:41.793947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.794402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:41.795176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:41.795615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.024083 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.041304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-16dd46af-7653-4d0e-9e68-aae37a0cf55b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.259353 Jul 20 19:25:42.042238 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 113/231] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:41 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:42.313911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.314517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:42.321873 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.322323 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.323131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.323520 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.586505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.604869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-92eaaf64-9aa7-4c6a-8610-e327ab8ea8d9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.295709 Jul 20 19:25:42.605971 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 119/232] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:42.645457 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:42.646534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:42.654306 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.655179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.656146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:42.656634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:42.730505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:42.738644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ee82f1c4-494c-4dbc-b485-7a2d13b1da85 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1211 microversion: 2.1 time: 0.097587 Jul 20 19:25:42.753312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 114/233] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:42 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:43.059314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.060281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.069830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.070955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.072386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.073068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.385932 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:43.396597 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1fe77368-4215-4f3f-8008-d96486c951eb tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.341471 Jul 20 19:25:43.397432 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 120/234] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:43.626263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.626918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.633954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.634402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.635366 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.635802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.767861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:43.768692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:43.783872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.784965 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.785955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:43.787181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:43.807754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:43.820874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3351a5bd-387e-499e-b64c-7f2b62a8ce7f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.198787 Jul 20 19:25:43.821779 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 115/235] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:44.002670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.012721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e69283a1-334c-4e18-a9ef-0b24f8033811 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.252248 Jul 20 19:25:44.013774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 121/236] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:43 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:44.126932 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-d6403ee3-7b4c-4fe7-a80e-5385189f9f10 req-0cf206c0-55d6-4b81-a612-687ef001604a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d469a829-8282-4106-a0d6-4197710acf5f", "tag": "3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:44.138542 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-d6403ee3-7b4c-4fe7-a80e-5385189f9f10 req-0cf206c0-55d6-4b81-a612-687ef001604a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.139236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-d6403ee3-7b4c-4fe7-a80e-5385189f9f10 req-0cf206c0-55d6-4b81-a612-687ef001604a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.152545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-d6403ee3-7b4c-4fe7-a80e-5385189f9f10 req-0cf206c0-55d6-4b81-a612-687ef001604a service nova] Creating event network-changed:3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2 for instance d469a829-8282-4106-a0d6-4197710acf5f on hv-cinder-81914 Jul 20 19:25:44.163206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-d6403ee3-7b4c-4fe7-a80e-5385189f9f10 req-0cf206c0-55d6-4b81-a612-687ef001604a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040206 Jul 20 19:25:44.164947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 116/237] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:44.415918 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:44.417041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:44.424559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.425150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.426258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.427081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.681360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.689110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-949374f7-a370-425d-bcdd-69355e1bf889 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.277730 Jul 20 19:25:44.690086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 122/238] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:44 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:44.838347 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:44.839041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:44.845197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.845699 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.846567 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:44.847842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:44.981460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:44.989354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-31281fd9-dca5-4718-a394-1e774a351b8c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.155731 Jul 20 19:25:44.989952 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 117/239] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:44 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:45.030001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:45.030605 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:45.036613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.037056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.037987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.038423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.057016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-6e2a2ab8-a709-4447-822d-3ea046172ea4 req-668355d8-1e14-41b7-b0fd-e01d9d3fd6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be1830e-3311-4a0d-bb66-ea396b0e20b2", "name": "network-vif-plugged", "status": "completed", "tag": "0f7ad1d9-e396-4d19-afee-ff1d009c6716"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:45.066019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6e2a2ab8-a709-4447-822d-3ea046172ea4 req-668355d8-1e14-41b7-b0fd-e01d9d3fd6d6 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.066483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6e2a2ab8-a709-4447-822d-3ea046172ea4 req-668355d8-1e14-41b7-b0fd-e01d9d3fd6d6 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.085870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-6e2a2ab8-a709-4447-822d-3ea046172ea4 req-668355d8-1e14-41b7-b0fd-e01d9d3fd6d6 service nova] Creating event network-vif-plugged:0f7ad1d9-e396-4d19-afee-ff1d009c6716 for instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 on hv-cinder-81914 Jul 20 19:25:45.091810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-6e2a2ab8-a709-4447-822d-3ea046172ea4 req-668355d8-1e14-41b7-b0fd-e01d9d3fd6d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038642 Jul 20 19:25:45.092492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 118/240] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:45.182799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:45.190466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8dc6a548-4d4b-4295-95e9-cd1d9d3e3f93 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.164395 Jul 20 19:25:45.191188 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 123/241] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:45 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:45.706901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:45.707517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:45.713750 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.714197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.714954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:45.715385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:45.845616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:45.853820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1ae58257-9f19-49cf-a924-017f95ac4fac tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.151266 Jul 20 19:25:45.854596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 119/242] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:45 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:46.006857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:46.007458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:46.013934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.014379 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.015134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.015566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.146576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:46.154087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0d1b7c2b-e965-4a9c-b1b0-51e33a285172 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.151649 Jul 20 19:25:46.154660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 124/243] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:46 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:46.207084 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:46.207684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:46.213752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.214197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.214978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.215412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.343377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:46.351634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b521a856-1453-4838-9bc9-4a5547ae7c36 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.148276 Jul 20 19:25:46.352124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 120/244] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:46 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:46.870745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:46.871347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:46.877364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.877815 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:46.878576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:46.879016 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.009723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:47.017833 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b96ae29d-5938-458f-9196-d2f17fca1dab tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.150995 Jul 20 19:25:47.018405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 125/245] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:46 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:47.171824 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:47.172458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:47.178475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.178916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.179670 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.180100 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.309861 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:47.317599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-42caf86b-4373-4f15-b8de-84b51b726e90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.150527 Jul 20 19:25:47.318654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 121/246] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:47 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:47.368220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:47.368885 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:47.375336 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.375792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.376591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:47.377030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:47.513026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:47.521861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-46016b06-e677-4e5a-80e1-1225c48d5a11 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.157683 Jul 20 19:25:47.522425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 126/247] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:47 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:48.035103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:48.035626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:48.042340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.042785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.043539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.043965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.170528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.178616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ae1faea6-ae86-43b0-b496-b22a76b206ce tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.147463 Jul 20 19:25:48.179516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 122/248] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:48 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:48.335468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:48.336073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:48.338405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.343730 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.344206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.344987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.345423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.477143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.484551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5b4c9215-2e0f-4bd5-b021-22bbf6bfc5da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.153486 Jul 20 19:25:48.485126 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 127/249] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:48 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:48.538232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:48.538842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:48.544794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.545240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.546010 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:48.546446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:48.691259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:48.700776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2ef46e47-9d1b-4a7a-889e-26e4b7b63f00 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.166338 Jul 20 19:25:48.701481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 123/250] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:48 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:49.196159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.196798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.202905 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.203364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.204130 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.204621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.331704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.339669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5109edfb-1133-45c2-b75c-cb6ec9b89078 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.147415 Jul 20 19:25:49.340249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 128/251] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:49.502143 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.502644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.509137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.509575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.510325 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.510776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.638005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.645697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-de79d89e-7dd6-4b80-bbfc-816eb328c7f6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.147246 Jul 20 19:25:49.646883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 124/252] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:49.717620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:49.718223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:49.724812 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.725258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.726021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:49.726457 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:49.855548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:49.863025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-08ed487f-0c43-4abc-aaa6-17716e7d6946 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.149277 Jul 20 19:25:49.863590 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 129/253] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:49 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.254518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.255008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.261621 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.262067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.262831 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.263271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.285920 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fa28294b-65cc-4faf-902f-23c4d27766aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/ips" status: 200 len: 152 microversion: 2.20 time: 0.035322 Jul 20 19:25:50.287624 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 125/254] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:25:50.356446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.357053 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.358892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=4 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.359564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=12 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.366977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.367469 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.368890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.369328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.505275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:50.513253 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f5036464-129c-49b6-8175-07329da1d9ae tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.160583 Jul 20 19:25:50.514063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 130/255] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.663433 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.664041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.666037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.671650 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.672098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.672897 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.673336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.808177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:50.816361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-159d5946-e626-40fe-b9a1-eacd2e5a2fe5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.157054 Jul 20 19:25:50.816941 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 126/256] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:50.880748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:50.881373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:50.887804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.888254 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:50.889041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:50.889478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.017503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.025565 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-722c0e7b-126e-461c-afca-d9596e780d02 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.149115 Jul 20 19:25:51.026030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 131/257] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:50 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:51.188709 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.189193 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.195700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.196148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.196939 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.197397 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.220904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1ab146ca-c64e-411f-b50d-6fc9975050e8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/ips" status: 200 len: 146 microversion: 2.1 time: 0.036436 Jul 20 19:25:51.221480 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 127/258] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:51.531057 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.531786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.537803 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.538256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.539020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.539459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.679028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.682424 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.687749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-95ee5126-4ea3-4e20-ad59-bce14afccdf6 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.160495 Jul 20 19:25:51.688334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 132/259] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:51.833759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:51.834375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:51.840702 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.841154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.841909 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:51.842342 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:51.857511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.975325 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:51.982755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d5f097f5-658d-49f9-898d-b9f4ed5a893d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.152879 Jul 20 19:25:51.983314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 128/260] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:51 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:52.043002 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:52.043613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:52.050180 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.050633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.051410 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.051846 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.261446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:52.269096 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7be769c1-7e7e-4bcf-9739-f679f369e9c3 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.229989 Jul 20 19:25:52.269662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 133/261] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:52 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:52.704220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:52.704853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:52.711646 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.712089 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.712875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:52.713302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:52.852589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:52.860703 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b9868f68-35a7-42f7-8444-f26549978a1f tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1313 microversion: 2.1 time: 0.160265 Jul 20 19:25:52.861273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 129/262] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:52 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:53.000955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:53.001646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:53.009673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.010127 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.010980 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.011458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.157970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:53.164811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2f225fe1-8f60-4c08-bb9d-b936d8c285c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.169060 Jul 20 19:25:53.165689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 134/263] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:52 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:53.290879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:53.292478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:53.299713 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=78 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.302753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.303320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.304364 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.305015 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.475448 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:53.484899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a79ddc2e-06b4-4768-b538-edfa691bf99b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.201927 Jul 20 19:25:53.488431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:53 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:53.875245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:53.875772 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:53.881328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:53.882073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.882414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:53.882583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.883357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.883790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.890269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.890702 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.891531 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:53.891959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:53.906273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lazy-loading 'flavor' on Instance uuid b30e5793-20b0-4600-b897-6f3c2de29b83 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:25:54.035272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.043847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9334b56a-67e0-4115-9960-4c841a19cb95 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1498 microversion: 2.1 time: 0.169471 Jul 20 19:25:54.044580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 131/265] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:53 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:54.183357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.184148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.198476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.198924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.199710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.200138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.221938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6efc4d0c-3725-4e76-a30b-1965f1a94cf8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/action" status: 202 len: 0 microversion: 2.20 time: 0.350519 Jul 20 19:25:54.222594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 135/266] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 19:25:53 2022] POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:25:54.232527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.233742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.241999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.242524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.243315 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.243798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.357154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.370134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2ae44e39-1634-47d2-8059-ae89e845b8c7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.191356 Jul 20 19:25:54.371157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 132/267] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:54.423244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbe8e07a-9d4f-4ee2-aadd-1e6573e8267d"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:54.424254 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.431952 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.432445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.433049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.433223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.433834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.442273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.444345 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.445537 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bae8b4ca-6a75-4eac-a47b-c82f40a2823f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.217566 Jul 20 19:25:54.446172 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 136/268] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:25:54.504845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.505899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.512903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.513523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.514306 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.514865 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.678556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:54.690760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d74e424d-b1ab-4c18-a4fd-df08f14f8eda tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.190769 Jul 20 19:25:54.691339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 137/269] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:54.696447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.697266 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.703588 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.704626 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.705218 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.705660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.734909 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:25:54.806936 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f04eda5a-d9de-44f4-ac66-d26d05984722 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389357 Jul 20 19:25:54.808104 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 133/270] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:25:54 2022] POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:54.827320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-aff2c09e-609f-4c3c-980b-1fe24274c80e tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 204 len: 0 microversion: 2.1 time: 0.134327 Jul 20 19:25:54.827919 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 138/271] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:25:54 2022] DELETE /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:25:54.845074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:54.847172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:54.856220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.856893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:54.858247 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:54.859038 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.009663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.017964 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-03f84fc5-ede5-4c1f-acc5-8c7a299114aa tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1504 microversion: 2.1 time: 0.182299 Jul 20 19:25:55.018864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 134/272] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:54 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:55.387897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:55.388620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:55.395219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.395701 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.397083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.397522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.466168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:55.467202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:55.474287 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.474820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.475889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.476704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.639509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.649920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4e835c04-532b-4949-98bc-a6d5e05196c6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.266310 Jul 20 19:25:55.650499 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 139/273] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:55 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:55.708160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.711606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:55.712348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:55.719410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.719881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.720363 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.720876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.721146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:55.721642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:55.722776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a8b9cc24-8f20-499f-af37-3a5f999c1f89 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.260653 Jul 20 19:25:55.723498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 135/274] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:25:55 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:25:55.858659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:55.867078 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6486e030-c3f8-40e4-83ed-2412ef427449 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.159804 Jul 20 19:25:55.867685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 140/275] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:55 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:56.035661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.036195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.042810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.043255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.044015 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.044475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.185298 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.193481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c73de25b-3c26-441a-8662-834a46cda7a3 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1504 microversion: 2.1 time: 0.162076 Jul 20 19:25:56.194063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 136/276] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:56.667937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.668573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.675049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.675499 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.676281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.676749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.745510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.746111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.753024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.753464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.754403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.754827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.913667 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.924769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.926548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:56.928097 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4cafbd06-d519-4566-a022-f491028e378f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.186798 Jul 20 19:25:56.941096 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 137/277] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:25:56.948883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:56.949487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:56.961926 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.963396 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:56.968715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:56.968715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.041388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.054053 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4fc7b0d3-f29f-4fe8-a517-ec952cc992c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.389958 Jul 20 19:25:57.055411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 141/278] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.120431 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-13da0564-c5e6-4a98-87df-e9ed9512807f req-04e4748f-23b0-4d2f-b90f-0837e5707b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d469a829-8282-4106-a0d6-4197710acf5f", "name": "network-vif-plugged", "status": "completed", "tag": "3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:57.154031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-13da0564-c5e6-4a98-87df-e9ed9512807f req-04e4748f-23b0-4d2f-b90f-0837e5707b6b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.154535 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-13da0564-c5e6-4a98-87df-e9ed9512807f req-04e4748f-23b0-4d2f-b90f-0837e5707b6b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.172448 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-13da0564-c5e6-4a98-87df-e9ed9512807f req-04e4748f-23b0-4d2f-b90f-0837e5707b6b service nova] Creating event network-vif-plugged:3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2 for instance d469a829-8282-4106-a0d6-4197710acf5f on hv-cinder-81914 Jul 20 19:25:57.181330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-13da0564-c5e6-4a98-87df-e9ed9512807f req-04e4748f-23b0-4d2f-b90f-0837e5707b6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062816 Jul 20 19:25:57.182395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 142/279] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:25:57.211829 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.216490 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:57.217401 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:57.223545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1ccb9a62-79d2-4e9a-9020-88ba7923e88b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.280966 Jul 20 19:25:57.225334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 138/280] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:56 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.234799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.234799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.237344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.237813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.564280 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:57.572562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dade5517-9078-40db-9254-b632e350fee9 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1504 microversion: 2.1 time: 0.362039 Jul 20 19:25:57.573149 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 143/281] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:57 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:57.831461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-49c5db4d-0853-40f6-a33e-343f7d0b9cb7 req-5d8dc6bc-a46f-429b-82f3-c923b2387daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be1830e-3311-4a0d-bb66-ea396b0e20b2", "name": "network-vif-deleted", "tag": "0f7ad1d9-e396-4d19-afee-ff1d009c6716"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:25:57.839770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-49c5db4d-0853-40f6-a33e-343f7d0b9cb7 req-5d8dc6bc-a46f-429b-82f3-c923b2387daf service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.840200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-49c5db4d-0853-40f6-a33e-343f7d0b9cb7 req-5d8dc6bc-a46f-429b-82f3-c923b2387daf service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.852186 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-49c5db4d-0853-40f6-a33e-343f7d0b9cb7 req-5d8dc6bc-a46f-429b-82f3-c923b2387daf service nova] Creating event network-vif-deleted:0f7ad1d9-e396-4d19-afee-ff1d009c6716 for instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 on hv-cinder-81914 Jul 20 19:25:57.857233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-49c5db4d-0853-40f6-a33e-343f7d0b9cb7 req-5d8dc6bc-a46f-429b-82f3-c923b2387daf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029406 Jul 20 19:25:57.857844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 139/282] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:25:57.946815 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:57.947363 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:57.954103 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.954550 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:57.955357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:57.955862 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.073550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:58.074252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:58.080527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.080988 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.082054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.082500 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.265811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.276000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.277853 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.279219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.279702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c684bfbb-53d4-4f57-832e-2e1deab9e631 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.336662 Jul 20 19:25:58.279792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 144/283] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:25:57 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:25:58.289093 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3218d212-eb8d-4d4b-ae55-6bccfeb5d8a4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.220107 Jul 20 19:25:58.289688 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 140/284] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:58.295617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:58.296226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:58.302469 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.302919 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.303693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.304132 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.475124 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.482590 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0d56f4fd-305d-4d94-a36a-c065cfad6bb7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.190792 Jul 20 19:25:58.483398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 145/285] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:58.590200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:58.590803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:58.597174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.597616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.598377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:58.598810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:58.660250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:58.667715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2cb1bfdf-09e9-471c-b86f-0c6b57e1da60 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1462 microversion: 2.1 time: 0.081408 Jul 20 19:25:58.668495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 141/286] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:58 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:59.297746 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.298445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.305586 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.306030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.306798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.307232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.313820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.315046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.321895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.322421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.323793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.324795 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.329664 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:59.475349 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.483254 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.484736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.486267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.487684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e0113ff7-4e2d-4213-89fc-414f5a51c976 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.194335 Jul 20 19:25:59.490135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 146/287] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:25:59.491088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a0a72e7a-10dd-4d57-9466-4ddf735f28a7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.181452 Jul 20 19:25:59.491931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 142/288] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:25:59.502742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.503516 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.510285 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.510809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.511745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.512243 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.647843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.657529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-16be7881-b263-4947-adf6-8d8e98d3d4a4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.158613 Jul 20 19:25:59.658223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 147/289] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:25:59.685565 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:25:59.686185 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:25:59.692976 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.693491 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.694173 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:25:59.694604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:25:59.757940 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:25:59.766272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-65f423e6-6beb-42e4-8129-784ea521c7b1 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1298 microversion: 2.1 time: 0.084419 Jul 20 19:25:59.766878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 143/290] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:25:59 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:00.506326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.507086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.507521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.507695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.514275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.514621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.514742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.515086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.515479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.515866 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.515985 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.516331 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.531565 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:00.660144 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.661055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.669564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2a37adc3-b339-4062-a8b0-f23a418dbd9f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.166710 Jul 20 19:26:00.671482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 144/291] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:00.672031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.673836 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.675157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7f0da616-d433-48df-bdda-3e48491201fc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.173469 Jul 20 19:26:00.675798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 148/292] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:00.681678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.682290 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.691365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.691815 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.692623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.693275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.785790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:00.786985 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:00.793314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.793879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.794782 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.795335 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.828170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:00.828656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:00.829105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lazy-loading 'fault' on Instance uuid 6be1830e-3311-4a0d-bb66-ea396b0e20b2 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:00.838820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.847006 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d8a7fb9e-75a3-4dcf-9a09-568ac22d243d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.174254 Jul 20 19:26:00.847898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 145/293] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:00.878529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:00.886081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-01f72ddf-8729-400c-b504-d586e6ee2432 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1303 microversion: 2.1 time: 0.104234 Jul 20 19:26:00.886651 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 149/294] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:00 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:01.688233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.688850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.694758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.695372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.696049 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.696543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.697310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.697732 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.702413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.702868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.703683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.704141 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.835842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.843844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4ddb9494-e582-4414-b873-93e1e84449f1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.159765 Jul 20 19:26:01.844466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 146/295] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:01.850271 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.858766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.860421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:01.861601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4c07baac-6cb5-4807-89a0-43778a80d20e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.171340 Jul 20 19:26:01.862157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 150/296] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:01.866570 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.867172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.873508 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.873957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.874723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.875152 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.903027 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:01.903806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:01.913174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.913655 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.914476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.914921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.951789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:01.952071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:01.952512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lazy-loading 'fault' on Instance uuid 6be1830e-3311-4a0d-bb66-ea396b0e20b2 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:26:01.994808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83ba05eb66ec44598ec0809cfc0c4ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aba8221c6e144e94ae026555d5317576', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:02.002927 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-873684e9-1ada-4394-858a-b9588aa9aae2 tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 200 len: 1303 microversion: 2.1 time: 0.103722 Jul 20 19:26:02.007269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 151/297] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:02.025155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:02.032733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-539b962c-58a1-4b65-973a-ffaef6dc74c8 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1267 microversion: 2.1 time: 0.171727 Jul 20 19:26:02.033308 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 147/298] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:01 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:02.861045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:02.861658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:02.868006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.868491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.869253 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.869683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.881111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:02.881740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:02.888265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.888735 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:02.889488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:02.889923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.016731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.025638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.026014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d52ce3da-abd1-48ed-ace1-a5463e0e9795 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.168664 Jul 20 19:26:03.026786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 152/299] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:02 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:03.031832 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.032473 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] [instance: 6be1830e-3311-4a0d-bb66-ea396b0e20b2] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.034347 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.036090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.037329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-319d913b-dee9-4127-9ae9-f7e5835740ba tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.160660 Jul 20 19:26:03.037886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 148/300] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:02 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:03.038598 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.039051 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.039819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.040255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.050458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.051106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.054023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] HTTP exception thrown: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Request method failure captured: Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 HTTP/1.1 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FaXZ0L9cCmH0w7sClrcd_FnbNkLue9S1EhnFEET_uIr-55X7c1gtCisriwClTxHZTFQqFVGUr15aUuwkwJBvgz5N8XGauR6rqXVexA98oHjhaDj_VUOqYhMzt884_kRYRIN3OT0oXZTonJDaV2kwDlFjsj19gy_kCPqPJ2yepv5Opc Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: aba8221c6e144e94ae026555d5317576 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesActionsTest-1332622078 Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:26:03.055672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aba8221c6e144e94ae026555d5317576"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aba8221c6e144e94ae026555d5317576"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aba8221c6e144e94ae026555d5317576", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aba8221c6e144e94ae026555d5317576"}]}] Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesActionsTest-1332622078 Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: aba8221c6e144e94ae026555d5317576 Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesActionsTest-1332622078 Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesActionsTest-1332622078-project Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 83ba05eb66ec44598ec0809cfc0c4ccd Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesActionsTest-1332622078-project Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. Jul 20 19:26:03.057032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '6be1830e-3311-4a0d-bb66-ea396b0e20b2'} Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:26:03.057789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. Jul 20 19:26:03.058945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:03.060071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] Returning 404 to user: Instance 6be1830e-3311-4a0d-bb66-ea396b0e20b2 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:26:03.060071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-059b01e0-25bd-4391-9b6f-0b233b89f08b tempest-VolumesActionsTest-1332622078 tempest-VolumesActionsTest-1332622078-project] 10.222.0.43 "GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2" status: 404 len: 111 microversion: 2.1 time: 0.029166 Jul 20 19:26:03.060210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.060334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 153/301] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/6be1830e-3311-4a0d-bb66-ea396b0e20b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:26:03.061216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.061216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.061216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.216482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.224278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a80a0288-260c-4e36-a6b3-50f2b429d007 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1455 microversion: 2.1 time: 0.177628 Jul 20 19:26:03.224966 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 149/302] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:03.242075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:03.242748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:03.248864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.249317 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.250092 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:03.250531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:03.398658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:03.407500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-04ba70d3-c383-485f-be18-2e863cd73f2e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1455 microversion: 2.1 time: 0.170315 Jul 20 19:26:03.408529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 154/303] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:03 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:04.047247 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.048054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.057931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.058745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.068364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.069643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.073308 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.074246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.074843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.075521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.076549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.079833 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.247996 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.259234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f35a41ce-6d7b-4921-983f-4a023774d7d3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.219027 Jul 20 19:26:04.259978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 150/304] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:04.344174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.353655 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.354562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.355940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4f8248e2-c0d7-4bbb-a6a7-37ad5a12d13e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.302314 Jul 20 19:26:04.356546 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 155/305] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:04.597209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-912c3930-8499-47b4-b27c-8507ef1e8096 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:04.603264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-912c3930-8499-47b4-b27c-8507ef1e8096 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.603714 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-912c3930-8499-47b4-b27c-8507ef1e8096 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.663795 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-912c3930-8499-47b4-b27c-8507ef1e8096 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Going to try to stop instance {{(pid=117769) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 19:26:04.708094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-912c3930-8499-47b4-b27c-8507ef1e8096 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action" status: 202 len: 0 microversion: 2.1 time: 0.114382 Jul 20 19:26:04.709525 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 151/306] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:26:04 2022] POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:26:04.717990 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:04.718743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:04.725220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.725757 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.726667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:04.727180 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:04.931444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:04.939568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-06fbb91f-6a50-4878-8698-edfecacb7b37 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.225644 Jul 20 19:26:04.940139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 156/307] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:04 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:05.277436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:05.278150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:05.284772 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.285221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.286027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.286988 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.374181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:05.374787 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:05.381522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.381979 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.382752 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.383194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.422263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.430682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c0121ef1-d8ae-4f21-8012-fd69085eb663 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.158102 Jul 20 19:26:05.431395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 152/308] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:05 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:05.580255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.589734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.591288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:05.592505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b468391b-1144-49e6-af23-6a601e6b0e09 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.222225 Jul 20 19:26:05.598304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-752fc364-cf65-4d79-807b-4dc17deca203 req-8996e4b2-86aa-46c7-926c-f37a973bf65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d469a829-8282-4106-a0d6-4197710acf5f", "tag": "3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:05.601290 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 157/309] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:05 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:05.607087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-752fc364-cf65-4d79-807b-4dc17deca203 req-8996e4b2-86aa-46c7-926c-f37a973bf65b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.607532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-752fc364-cf65-4d79-807b-4dc17deca203 req-8996e4b2-86aa-46c7-926c-f37a973bf65b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.618313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-752fc364-cf65-4d79-807b-4dc17deca203 req-8996e4b2-86aa-46c7-926c-f37a973bf65b service nova] Creating event network-changed:3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2 for instance d469a829-8282-4106-a0d6-4197710acf5f on hv-cinder-81914 Jul 20 19:26:05.623387 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-752fc364-cf65-4d79-807b-4dc17deca203 req-8996e4b2-86aa-46c7-926c-f37a973bf65b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028760 Jul 20 19:26:05.623992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 153/310] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:26:05.957534 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:05.958160 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:05.964820 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.965264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:05.966025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:05.966457 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.105383 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.113417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0faf654a-8c57-4cee-b9cf-7f64403b4507 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.159696 Jul 20 19:26:06.113896 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 158/311] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:05 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:06.448463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:06.449652 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:06.456714 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.457321 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.458169 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.459473 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.601317 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.610170 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-13c47c0c-bbe0-4a91-893b-f1ec4ce8e54c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.165908 Jul 20 19:26:06.610806 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 154/312] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:06 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:06.611483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:06.612459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:06.618933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.619741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.620559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:06.621181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:06.750267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.758787 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.760329 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:06.761488 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b15c4d8e-ff0e-4c26-84cd-94af7d370028 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.154296 Jul 20 19:26:06.762055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 159/313] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:06 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:07.131993 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.132875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.139165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.139572 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.140548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.141129 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.271627 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.279413 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-651e3199-6ae6-4b46-8dad-1b70125687a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.151920 Jul 20 19:26:07.279971 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 155/314] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:07.626938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.627626 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.634263 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.634715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.635584 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.636090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.780425 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:07.781065 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:07.788855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.789294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.790088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:07.790497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:07.925406 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.934067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.935863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:07.937241 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dd70f05a-c9d2-4294-a0b5-30b3213ea9cb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.160797 Jul 20 19:26:07.938684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 156/315] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:07.992560 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:08.000111 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7f3a420e-4d23-497c-8084-aade2481e8da tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.377024 Jul 20 19:26:08.000708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 160/316] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:07 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:08.295708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:08.296335 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:08.303081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.303531 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.304310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.304757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.492754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:08.502906 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-96315e54-d677-4f4f-9af3-4c3f2257ed73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.210880 Jul 20 19:26:08.503790 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 157/317] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:08 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:08.956389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:08.956886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:08.967298 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.967825 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:08.968717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:08.969770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.017441 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:09.018030 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.062257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.067066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.076758 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.078538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.212124 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.230544 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.233205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.234665 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e8b05a46-9e1c-409c-95b0-c41b5be5fda4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.283502 Jul 20 19:26:09.235512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 161/318] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:08 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:09.323220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.336814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1ba8e937-2521-49f0-bd50-01d5d8bdc4ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1501 microversion: 2.1 time: 0.323405 Jul 20 19:26:09.337410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 158/319] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:09 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:09.357255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c2f4338-082c-46d7-9b94-089ce2264966"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:09.359033 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.369849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.370485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.371589 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.372372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.407587 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] HTTP exception thrown: Cannot 'attach_volume' instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 while it is in vm_state rescued Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Request method failure captured: Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/os-volume_attachments HTTP/1.1 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 74 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZIvF9ugpYe7-0EakHvix28xoFUPQn3x00w9KlsVzx0MTq9fViqd6xYxIRuVykPcSdM1tmeO8WbrYvngtZjMNZUDCwo9vCvRY7cqq20wFulaUk9Q9wgJPdKIVPxV2mqDDKlGy4LzA80A3dKZgYxMkIipqBj12PxR2ekvxmnIcoYR20 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:26:09.410583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0f63357734c4efa9a88c07996aa5551", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}] Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: cb06eeba738b452fab3986de7e1f7856 Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {"volumeAttachment": {"volumeId": "3c2f4338-082c-46d7-9b94-089ce2264966"}} Jul 20 19:26:09.411860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Cannot 'attach_volume' instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 while it is in vm_state rescued Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'server_id': '057f48c6-98d1-43fb-ab77-526c7ff0cf07', 'body': {'volumeAttachment': {'volumeId': '3c2f4338-082c-46d7-9b94-089ce2264966'}}} Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:26:09.412634 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 while it is in vm_state rescued Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:26:09.413718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 while it is in vm_state rescued Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Returning 409 to user: Cannot 'attach_volume' instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 while it is in vm_state rescued {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dedbfe17-030f-4635-9d8e-44c788d1f007 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063232 Jul 20 19:26:09.414773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 162/320] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:26:09 2022] POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 19:26:09.422133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:09.422796 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.433575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.434535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.435751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.436668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.525049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:09.525818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.542631 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.543805 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.545026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.545720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.575740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8586d7c0-0d3d-4d40-a986-2306484e1953 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/action" status: 202 len: 0 microversion: 2.1 time: 0.157697 Jul 20 19:26:09.576407 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 159/321] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:26:09 2022] POST /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:26:09.590570 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:09.591275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:09.598237 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.599160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.600357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:09.601036 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:09.620092 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:09.804544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:09.813955 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ce8dc111-9f79-408f-964d-427dfbebdb9d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1509 microversion: 2.1 time: 0.231936 Jul 20 19:26:09.814999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 160/322] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:09 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:10.168321 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.214403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5e79a42d-5d07-4d4f-ae9d-143342b6fc02 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.696690 Jul 20 19:26:10.225740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 163/323] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:09 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:10.256138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:10.256806 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:10.269252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.269803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.270682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.271255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.448769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.461264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.465149 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:10.466606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a2791076-997f-438e-ba42-4f4e3f08ad63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.215643 Jul 20 19:26:10.468743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 161/324] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:10 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:10.835818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:10.836761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:10.846245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.847199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:10.848559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:10.849387 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.018544 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.031028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-90c089e9-560a-459b-b5db-fb2896775259 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1509 microversion: 2.1 time: 0.200058 Jul 20 19:26:11.034938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 164/325] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:10 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:11.235797 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:11.241181 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:11.266421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.267022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.268825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.269523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.487141 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:11.487868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:11.498947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.500169 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.514415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:11.515125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:11.616548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.624919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e964efc7-8387-467a-9c7c-a0d836d894f3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.393699 Jul 20 19:26:11.640221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 162/326] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:11 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:11.715128 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.724854 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.726527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:11.727706 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b22d1823-5eb6-4e36-ae0e-e042bf44fee8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.245941 Jul 20 19:26:11.728268 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 165/327] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:11 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:12.051048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.051647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.058598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.059054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.059815 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.060250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.213250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.220088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-64d95ec2-5ee0-4645-b9d1-4fcf1d96a9d2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1509 microversion: 2.1 time: 0.172791 Jul 20 19:26:12.220891 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 163/328] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:12.650082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.651117 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.664877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.665298 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.667996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.668793 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.746042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:12.746606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:12.762222 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.765814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.766680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:12.767165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:12.912808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.921911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9050d733-56a0-47b0-892e-9b7d350d0344 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.278271 Jul 20 19:26:12.922484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 166/329] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:12.971236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.984058 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.986372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:12.988136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f92a8815-bbe6-4303-bcdf-fd606496e679 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.245769 Jul 20 19:26:12.989183 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 164/330] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:12 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:13.240642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:13.241360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:13.248526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.248977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.249778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.250211 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.402530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:13.410636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5f2d7370-ff66-4e9e-ac23-023b4a7a0b97 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1509 microversion: 2.1 time: 0.174615 Jul 20 19:26:13.411208 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 167/331] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:13 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:13.943018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:13.943829 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:13.955762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.956357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:13.959717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:13.960202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.007813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:14.008456 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:14.019026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.019483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.020403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.023483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.132746 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.142722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6f7f2e4b-5ea1-4a3b-9403-5d6893b64b84 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.207036 Jul 20 19:26:14.155632 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 165/332] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:13 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:14.310799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.331862 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.347937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.352727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7c784d7f-492a-4d9f-a934-3a0a981d5170 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1745 microversion: 2.20 time: 0.345850 Jul 20 19:26:14.355377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 168/333] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:14 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1745 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:14.430813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:14.437358 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:14.448750 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.449287 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.450126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:14.450627 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:14.777044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:14.785575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-684ac92a-3cd3-4b5f-8080-bc97227775af tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1515 microversion: 2.1 time: 0.360946 Jul 20 19:26:14.799747 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 166/334] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:14 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1515 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:15.167064 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:15.169189 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:15.188168 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.189568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.197607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.198270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.380091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:15.382583 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:15.392005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.392862 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.394380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:15.395024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:15.399411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.412734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-99f5e9f8-3658-46e2-a783-8df2d1143af2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.252512 Jul 20 19:26:15.413954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 169/335] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:15 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:15.579053 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.591447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.596504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:15.599929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e0f0efbc-dcdf-4388-841a-dabffda17ef6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1745 microversion: 2.20 time: 0.227869 Jul 20 19:26:15.616091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 167/336] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:15 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1745 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:16.376942 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c66b3de8-c38e-4455-8055-1b9f27546950 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: .version_select at 0x7f26c16ebaf0>, body: {"keypair": {"name": "tempest-keypair-145603414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID8vZhzOtTwk7GHUShM2E14ezT21tMetJRRd4BN04hNPQ6jYzhaNPQxqlTDaHNtB50X7uNPoMDaaNGMZwOpYEIouKHOi7CQh/W7Yy89g+cUwBmWloYizRUhH8AlfmRXZw=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:16.421212 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-c66b3de8-c38e-4455-8055-1b9f27546950 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for project f0f63357734c4efa9a88c07996aa5551. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:16.431361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:16.432603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:16.441974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:16.447553 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-c66b3de8-c38e-4455-8055-1b9f27546950 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for user cb06eeba738b452fab3986de7e1f7856 and project f0f63357734c4efa9a88c07996aa5551. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:16.448599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.450497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.460474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.461159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.512752 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c66b3de8-c38e-4455-8055-1b9f27546950 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143426 Jul 20 19:26:16.518948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 170/337] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:26:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:16.621613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:16.622187 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:16.639139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.639827 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.640798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:16.641376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:16.846888 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.857297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2efa7c8c-ce5e-4a62-a12f-b4bccbdd30ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.430885 Jul 20 19:26:16.860551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 168/338] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:16 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:16.885998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.900667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.902316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:16.904107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e0d29108-6129-4d1d-b15e-317beb00f429 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.287678 Jul 20 19:26:16.910066 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 171/339] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:16 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:17.874900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:17.875666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:17.889310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.893678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.895114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.895818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.929945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:17.931719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:17.945814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.946478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:17.947620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:17.947931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:18.191642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.204766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.219390 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.222996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-00706f43-80f6-40fe-b25f-0d444fd2903c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.298110 Jul 20 19:26:18.229859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 172/340] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:17 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:18.719917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:18.732083 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3f15f403-304c-4c82-b884-fab6a43586b1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.860941 Jul 20 19:26:18.735522 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 169/341] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:17 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:19.242571 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:19.243417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:19.263644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.265668 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.274178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.274636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.431060 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-bb208ac3-9d7f-412f-a9f6-06442b11ea05 req-0fccf570-a7e9-4d31-aa23-4cfe640f3bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "name": "network-vif-plugged", "status": "completed", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:19.446333 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-bb208ac3-9d7f-412f-a9f6-06442b11ea05 req-0fccf570-a7e9-4d31-aa23-4cfe640f3bed service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.448819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-bb208ac3-9d7f-412f-a9f6-06442b11ea05 req-0fccf570-a7e9-4d31-aa23-4cfe640f3bed service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.478303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-bb208ac3-9d7f-412f-a9f6-06442b11ea05 req-0fccf570-a7e9-4d31-aa23-4cfe640f3bed service nova] Creating event network-vif-plugged:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:26:19.488992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-bb208ac3-9d7f-412f-a9f6-06442b11ea05 req-0fccf570-a7e9-4d31-aa23-4cfe640f3bed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062388 Jul 20 19:26:19.500640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 170/342] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:19.656712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:19.683746 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:19.694836 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:19.702942 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2944ec08-c808-440c-ab86-5b4b1b63e416 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.465409 Jul 20 19:26:19.710202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 173/343] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:19 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:19.755299 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:19.756350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:19.769226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.770084 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:19.771560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:19.782134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.087079 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1179157004", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb30eef5-f970-4e36-86fc-a729873274d6"}], "security_groups": [{"name": "tempest-securitygroup--868265875"}], "key_name": "tempest-keypair-145603414", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:20.250069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:20.263212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-79174425-8bb9-4764-9572-b7185c3f4129 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.513621 Jul 20 19:26:20.279928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 171/344] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:19 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:20.734771 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:20.738335 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:20.747832 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.748674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.749779 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:20.750375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:20.947299 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:20.965808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:20.967611 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:20.969886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-181c14d6-09b5-40dd-ae8e-42859720bc2c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.246879 Jul 20 19:26:20.981997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 172/345] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:20 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:21.287472 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:21.288424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:21.307977 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:21.308476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.309460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:21.310063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:21.595199 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:21.603762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c7f17617-9929-4907-a15b-7a9588e1636f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.320651 Jul 20 19:26:21.607236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 173/346] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:21 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:21.991492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:21.992399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:21.999574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.003320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.011052 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.012856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.211115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.233206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.235341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.237105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a1a0554e-345e-4396-87fe-300e7e5cb0d0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.251311 Jul 20 19:26:22.238334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 174/347] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:21 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:22.624974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:22.625600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:22.645804 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.646206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.647008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:22.647450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:22.894368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:22.904894 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c9d2e58b-42d0-4b00-93cf-e760a511ba9e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.283583 Jul 20 19:26:22.909574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 175/348] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:22 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:23.256663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:23.257325 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:23.269908 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.270817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.272012 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.272699 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.538266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.548204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.549739 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:23.551134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ec064d95-7810-4cdc-bf98-073eaa0efa23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.298657 Jul 20 19:26:23.551701 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 176/349] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:23 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:23.928199 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:23.929060 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:23.931504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=94 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:23.943467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.944342 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.945485 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:23.946188 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:23.951966 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:24.214919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.233642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7a4b0155-eaea-4b85-9d1a-220d4cdbb3cb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.311142 Jul 20 19:26:24.234437 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 177/350] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:23 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:24.571240 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:24.572714 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:24.581697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.582512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.583553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:24.584200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:24.863318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.873291 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.875204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:24.876588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8f15c85c-86af-43b3-bd1b-ff6d83f9984d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.311121 Jul 20 19:26:24.888175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 178/351] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:24 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:25.257870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:25.258584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:25.265290 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.268978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.270053 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.273017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.512041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:25.524774 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1eba9a67-b069-45b3-ac4c-bf070e783d94 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.270790 Jul 20 19:26:25.525362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 179/352] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:25 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:25.896890 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:25.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:25.906275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.906720 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:25.907558 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:25.907989 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.206201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.227441 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.228989 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.230162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-383a5085-1db2-4143-ab26-83c9e530a073 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.338807 Jul 20 19:26:26.230722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 180/353] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:25 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:26.478728 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=4 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:26.547182 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:26.547799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:26.557177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:26.557623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.558400 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:26.558834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:26.851681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:26.870019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5067259e-e6a5-4001-bea6-38c1cfb177be tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.326556 Jul 20 19:26:26.870607 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 181/354] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:26 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:27.277980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:27.280009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:27.360098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.360800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.361755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.362331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.586872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:27.597660 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:27.599951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:27.601679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9e2edfbe-e248-4a36-906a-b9f174ef4d07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.356799 Jul 20 19:26:27.602764 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 182/355] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:27 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:27.895445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:27.896972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:27.903780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.904554 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:27.905490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:27.909021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:28.066889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:28.076154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a0da99df-760f-4589-baf4-55201034b1d8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.184710 Jul 20 19:26:28.078518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 183/356] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:27 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:28.625145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:28.626081 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:28.644125 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:28.644814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:28.645624 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:28.646134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:28.891395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:28.900978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:28.902997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:28.904556 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3eadb888-0042-4f40-af26-0abc90f16d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1740 microversion: 2.20 time: 0.283513 Jul 20 19:26:28.905900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 184/357] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:28 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1740 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:29.099035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:29.099678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:29.105860 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.110665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.111705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.115170 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.274820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:29.285092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-652eb7d1-60fe-4ec3-af26-a8d220a51a77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1723 microversion: 2.1 time: 0.189373 Jul 20 19:26:29.285946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 185/358] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:29 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:29.345982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] validate_networks() for [('cb30eef5-f970-4e36-86fc-a729873274d6', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:26:29.664410 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=56 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:29.763793 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:26:29.764307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:26:29.764884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:26:29.765362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:26:29.765842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:26:29.775286 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.775859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.776713 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.777156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.794576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:29.798836 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Getting quotas for user cb06eeba738b452fab3986de7e1f7856 and project f0f63357734c4efa9a88c07996aa5551. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:29.811631 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:26:29.814450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:26:29.861131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-39ff16a1-0a83-4019-8430-5833a005f331 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.781094 Jul 20 19:26:29.861705 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 174/359] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:26:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 9782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:26:29.872145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b7aeb84b-2bcd-42e6-bab6-da2636c5be8a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:29.872858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b7aeb84b-2bcd-42e6-bab6-da2636c5be8a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:29.929676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:29.930415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:29.934599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b7aeb84b-2bcd-42e6-bab6-da2636c5be8a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:29.940125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.940865 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.941824 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:29.942270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:29.943268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b7aeb84b-2bcd-42e6-bab6-da2636c5be8a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1245 microversion: 2.1 time: 0.074839 Jul 20 19:26:29.944008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 186/360] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:29 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:30.140139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.153084 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.154616 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.155795 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-759a1fac-8cf2-48b1-9172-e3c7510e3e92 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1722 microversion: 2.20 time: 0.233815 Jul 20 19:26:30.156380 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 175/361] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:29 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:30.302831 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:30.304109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:30.311367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.311880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.312716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.313581 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.486814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.498922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a75f71a9-7e04-4b76-9afe-1f57740ba6d6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1700 microversion: 2.1 time: 0.200412 Jul 20 19:26:30.499687 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 187/362] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:30 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1700 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:30.515903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d82f2cb0-25e5-4aa0-a474-ebe1cc42fdbb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:30.525967 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d82f2cb0-25e5-4aa0-a474-ebe1cc42fdbb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.526434 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d82f2cb0-25e5-4aa0-a474-ebe1cc42fdbb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.595704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d82f2cb0-25e5-4aa0-a474-ebe1cc42fdbb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Going to try to start instance {{(pid=117768) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 19:26:30.651035 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d82f2cb0-25e5-4aa0-a474-ebe1cc42fdbb tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action" status: 202 len: 0 microversion: 2.1 time: 0.139030 Jul 20 19:26:30.651926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 176/363] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:26:30 2022] POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:26:30.661375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:30.661963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:30.668168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.668631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.669395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.669823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.845343 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:30.853473 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-83a4fa62-ecce-4541-a035-c60c0116bc9c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1709 microversion: 2.1 time: 0.196909 Jul 20 19:26:30.854041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 188/364] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:30 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:30.961738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:30.962446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:30.977694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.978233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:30.979140 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:30.979570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.083736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:31.092388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b018b49e-df1f-4006-8ac1-8dd3a6c16daa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1297 microversion: 2.1 time: 0.135855 Jul 20 19:26:31.093561 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 177/365] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:30 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:31.176066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:31.177499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:31.185452 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.185893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.186651 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.187261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.343660 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:31.353089 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:31.354596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:31.355739 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8da1b28c-297a-4899-88df-5c958c659cea tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1722 microversion: 2.20 time: 0.184392 Jul 20 19:26:31.356311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 189/366] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:31 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:31.871041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:31.871639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:31.878179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.878630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:31.879388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:31.879821 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.015024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:32.024020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4ce34c25-ea45-49bb-af67-76229878cded tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1709 microversion: 2.1 time: 0.156641 Jul 20 19:26:32.026474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 178/367] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:31 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1709 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:32.110480 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:32.111083 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:32.117763 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.118207 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.119038 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.119651 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.197226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:32.204746 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-773e65cb-e313-4274-944b-3cb5e04ac124 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1305 microversion: 2.1 time: 0.098070 Jul 20 19:26:32.205314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 190/368] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:32 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:32.375040 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:32.376343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:32.385076 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.385748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.386845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:32.387481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:32.531222 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:32.539981 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:32.541636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:32.542813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3391de03-13fa-4c5c-804a-158b9770dc1b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1722 microversion: 2.20 time: 0.172350 Jul 20 19:26:32.543376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 179/369] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:32 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:33.043748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:33.044405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:33.053868 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.054338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.055151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.055605 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.228501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:33.231641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:33.241586 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.242357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.243615 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.244177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.361377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.371327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0c382ac8-24e1-4c9e-9ad1-a6ec9934cd24 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1303 microversion: 2.1 time: 0.152410 Jul 20 19:26:33.372898 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 180/370] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:33 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:33.398127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.406577 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-94352d2a-0860-4fe6-81b6-ba459b4f30ff tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1709 microversion: 2.1 time: 0.367998 Jul 20 19:26:33.407515 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 191/371] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:33 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1709 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:33.561799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:33.562404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:33.569970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.570692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.571671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.572272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.780157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.791867 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.794011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:33.795914 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1cc43b77-6a92-4412-b7c6-1eaf8d961e77 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1725 microversion: 2.20 time: 0.238129 Jul 20 19:26:33.797054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 181/372] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:33 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:33.815693 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d23a7c44-b718-48d1-8a55-59dfbf2e67cd"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:33.817662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:33.838373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.838825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:33.839644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:33.840088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.144713 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:34.306035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-21765fc4-6a3b-4a3c-83b3-80d1c96c69f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.495176 Jul 20 19:26:34.306665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 192/373] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jul 20 19:26:33 2022] POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments => generated 188 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:26:34.396751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:34.397600 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:34.406164 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.406904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.407817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.408502 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.425018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:34.429094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:34.441143 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.441681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.443171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.443606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.624438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:34.636456 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-65593288-59b8-467d-9133-29298a366650 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.248924 Jul 20 19:26:34.648720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 182/374] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:34 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:34.653860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:34.654430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:34.657195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:34.670273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.670707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1d9390db-bb35-44f3-92fd-071bf5810648 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1709 microversion: 2.1 time: 0.251459 Jul 20 19:26:34.671641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 193/375] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:34 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1709 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:34.672598 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.673635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.674235 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.810148 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0b92b424-ece2-415e-a1ff-c076500cc38a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/action" status: 202 len: 0 microversion: 2.20 time: 0.160164 Jul 20 19:26:34.810952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 183/376] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 19:26:34 2022] POST /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:26:34.821277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:34.822123 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:34.829728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.830054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:34.830829 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:34.831428 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.001463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:35.039136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:35.073823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:35.080444 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-32f328d9-2357-4496-bcfb-cd14b9c2d1e7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1751 microversion: 2.20 time: 0.264646 Jul 20 19:26:35.081051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 194/377] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:34 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:35.260414 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-672f43bc-d893-4dab-8c04-ada28a0671ee req-9d158cdb-5f22-4fa4-b1ea-58960f0f720c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "name": "network-vif-unplugged", "status": "completed", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:35.277773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-672f43bc-d893-4dab-8c04-ada28a0671ee req-9d158cdb-5f22-4fa4-b1ea-58960f0f720c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.280351 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-672f43bc-d893-4dab-8c04-ada28a0671ee req-9d158cdb-5f22-4fa4-b1ea-58960f0f720c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.309392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.compute.server_external_events [req-672f43bc-d893-4dab-8c04-ada28a0671ee req-9d158cdb-5f22-4fa4-b1ea-58960f0f720c service nova] Unable to find a host for instance b30e5793-20b0-4600-b897-6f3c2de29b83. Dropping event network-vif-unplugged {{(pid=117768) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 19:26:35.310332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-672f43bc-d893-4dab-8c04-ada28a0671ee req-9d158cdb-5f22-4fa4-b1ea-58960f0f720c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054033 Jul 20 19:26:35.311326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 184/378] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 19:26:35.613488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-8a8b174b-674b-4e55-bfd0-824dfbd2da83 req-55b68018-7560-4124-9614-8894ebbd262a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:35.635263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8a8b174b-674b-4e55-bfd0-824dfbd2da83 req-55b68018-7560-4124-9614-8894ebbd262a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.635951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8a8b174b-674b-4e55-bfd0-824dfbd2da83 req-55b68018-7560-4124-9614-8894ebbd262a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.654177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:35.654914 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:35.668273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.668743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.676399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.676399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.677280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-8a8b174b-674b-4e55-bfd0-824dfbd2da83 req-55b68018-7560-4124-9614-8894ebbd262a service nova] Creating event network-changed:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:26:35.691802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-8a8b174b-674b-4e55-bfd0-824dfbd2da83 req-55b68018-7560-4124-9614-8894ebbd262a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088348 Jul 20 19:26:35.709550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 195/379] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:35.717853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:35.718788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:35.735634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.736017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.736794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:35.747063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:35.965710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:35.978169 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c4d15df4-7b0e-4eec-90ef-c94da607133f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1713 microversion: 2.1 time: 0.266882 Jul 20 19:26:35.980892 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 196/380] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:35 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1713 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:35.990368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1497717261", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:36.000725 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:36.014531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-010caf77-62a4-4798-9b1d-3af4e080d3ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.362198 Jul 20 19:26:36.015255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 185/381] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:35 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:36.105225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:36.105994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:36.115862 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:36.116548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:36.117483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:36.118013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:36.435680 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:36.445137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:36.446545 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:36.447708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-229f88c0-597c-4e75-9227-cf4f0b341cb1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1751 microversion: 2.20 time: 0.352440 Jul 20 19:26:36.448266 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 186/382] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:36 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1751 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:37.031943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:37.032685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:37.039137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.039592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.040387 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.040831 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.173383 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:37.182171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a5f2a54f-9035-47e7-9b8c-8537936d34b9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.153400 Jul 20 19:26:37.182171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 187/383] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:37 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:37.466946 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:37.467465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:37.473551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.474497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.475262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:37.475703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:37.607408 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:37.617712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:37.619302 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:37.620611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c65e94b0-9a7c-423e-ae62-e17eda95a94d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1753 microversion: 2.20 time: 0.157790 Jul 20 19:26:37.621167 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 188/384] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:37 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:38.199528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:38.200228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:38.206836 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.207383 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:38.208761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.209298 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:38.404082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:38.408214 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:38.412910 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fb25b1f2-ed83-4b71-bd70-62a2c4ddb8c8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.217258 Jul 20 19:26:38.413486 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 189/385] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:38 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:38.639501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:38.640112 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:38.647681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.648133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:38.648932 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:38.649376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:38.782490 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:38.791021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:38.792580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:38.793746 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0e73c0b9-cad6-4da4-9fc1-99b3113796dc tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.158146 Jul 20 19:26:38.794311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 190/386] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:38 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:39.429846 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:39.430646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:39.436999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.437716 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.438767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.439212 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.638279 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.647484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0de2af6d-1076-4312-8644-198a8dc20da4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.221318 Jul 20 19:26:39.649022 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 191/387] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:39 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:39.815201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:39.816018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:39.818619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.819272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.825072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.825516 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.826281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:39.826713 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:39.939875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:39.966232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.974681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.976195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:39.977375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-eebbe2ac-4f88-40b4-84be-63597e2fae64 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.167260 Jul 20 19:26:39.977938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 192/388] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:39 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:40.665277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:40.666016 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:40.672484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:40.672944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:40.673734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:40.674177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:40.811277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:40.819008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-42692c5a-3079-4312-8754-c34269ae62cc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.158279 Jul 20 19:26:40.819575 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 193/389] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:40 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:40.994653 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:40.995316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:41.001565 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.002019 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:41.002797 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.003228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:41.139573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:41.148999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:41.150841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:41.152017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-792fca3d-7aa7-41ad-a648-50628f4f4e3a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.161331 Jul 20 19:26:41.152611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 194/390] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:40 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:41.835255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:41.835912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:41.842367 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.842813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:41.843566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:41.844036 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:41.980497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:41.988864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9c6dd73f-f9bd-478e-8728-77dea48dc9f3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.157343 Jul 20 19:26:41.989455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 195/391] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:41 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:42.170376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:42.171006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:42.177218 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:42.178184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:42.178969 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:42.179411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:42.320110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:42.329259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:42.330768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:42.331933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-aceb4b7c-1672-421a-b649-8bbce13ea302 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.165497 Jul 20 19:26:42.333174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 196/392] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:42 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:43.006892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:43.007891 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:43.014242 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.014722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.015508 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.015944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.154295 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.164081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f7672b67-7ad7-4608-a2d7-2f1e0d7fe9fb tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.161681 Jul 20 19:26:43.165588 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 197/393] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:43 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:43.290264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-b194b032-13c9-41ee-80ac-c77e221e033b req-81e86292-9ce8-4227-96f2-7abd9562a647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:43.298656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-b194b032-13c9-41ee-80ac-c77e221e033b req-81e86292-9ce8-4227-96f2-7abd9562a647 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.299205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-b194b032-13c9-41ee-80ac-c77e221e033b req-81e86292-9ce8-4227-96f2-7abd9562a647 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.313527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-b194b032-13c9-41ee-80ac-c77e221e033b req-81e86292-9ce8-4227-96f2-7abd9562a647 service nova] Creating event network-vif-plugged:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:26:43.319102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-b194b032-13c9-41ee-80ac-c77e221e033b req-81e86292-9ce8-4227-96f2-7abd9562a647 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Jul 20 19:26:43.319725 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 198/394] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:26:43.357953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:43.358691 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:43.366277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.366654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.367424 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:43.368060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:43.548451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.558299 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.560023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:43.561333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e6cde7b6-0c9a-4dec-838f-bf52d84edc9d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.209489 Jul 20 19:26:43.561976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 199/395] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:43 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:44.183625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:44.184453 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:44.191075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.191526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.192308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.192760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.322900 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.330269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b66d66bd-525d-4672-a95f-b8d9252a1f25 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.150804 Jul 20 19:26:44.330837 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 200/396] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:44 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:44.580047 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:44.580671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:44.591038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.591491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.592274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:44.592736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:44.763295 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.772532 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.774034 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:44.775194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6ec949ca-66db-41df-a19b-c70f3a33a848 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.198960 Jul 20 19:26:44.776060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 201/397] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:44 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:45.347948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:45.348731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:45.356078 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.356562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.357338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.357777 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.527025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] validate_networks() for None {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:26:45.568216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:45.576382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a569180c-f8d5-4307-9c9d-5696504f24e6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1370 microversion: 2.1 time: 0.232959 Jul 20 19:26:45.587751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 202/398] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:45 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:45.794375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:45.795008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:45.802227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.802857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.805191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.805317 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.857698 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:26:45.858243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:26:45.859164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:26:45.859793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:26:45.860666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:26:45.871420 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.872221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.873283 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:45.873823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:45.894789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Getting quotas for project 2765674134b8415f8ab79fc7295fbe1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:26:45.899701 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Getting quotas for user a1ceda5bed824184b10bfaff48ee006c and project 2765674134b8415f8ab79fc7295fbe1d. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:26:45.911586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:26:45.914022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:26:45.978745 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9f9e6aac-5421-4423-bbcf-fe8486b874eb tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.996586 Jul 20 19:26:45.979740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 197/399] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:26:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 9998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:26:46.000877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b6680eb0-f3d2-4c6d-b9fb-14b3dc4f6a40 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:46.001618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b6680eb0-f3d2-4c6d-b9fb-14b3dc4f6a40 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:46.003960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.015506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.037540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.041649 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e37e2a99-af52-418f-88aa-931a6970534b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.251041 Jul 20 19:26:46.044126 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 203/400] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:45 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:26:46.119516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b6680eb0-f3d2-4c6d-b9fb-14b3dc4f6a40 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.131048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b6680eb0-f3d2-4c6d-b9fb-14b3dc4f6a40 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1215 microversion: 2.1 time: 0.144359 Jul 20 19:26:46.135180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 198/401] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:45 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:46.596217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:46.597549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:46.606198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:46.607982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.608641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.609770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.610474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.793780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:46.802743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a24e4bfa-bb26-465e-a6de-01ec28f3a901 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1563 microversion: 2.1 time: 0.211600 Jul 20 19:26:46.804479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 204/402] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:46 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1563 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:46.820817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:46.821449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:46.828862 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.829310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.830092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:46.830532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:46.919533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9c9154e2-c465-40f7-961d-99cf7883c620 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103236 Jul 20 19:26:46.920137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 199/403] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:26:46 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:47.066401 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:47.067293 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:47.077462 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.078001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.078854 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.079398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.156505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:47.165283 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:47.189228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.189889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.191084 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:47.195524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:47.294229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:47.303244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-33c524c6-c2e0-46df-b4f9-5d0348fe987b tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.151126 Jul 20 19:26:47.304132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 200/404] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:47 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:47.611108 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:47.621267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:47.623306 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:47.624834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8520a100-92e6-4d2f-a51a-22571b3eec22 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.563915 Jul 20 19:26:47.625408 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 205/405] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:47 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:48.334747 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:48.335674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:48.348844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.349451 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.350971 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.351518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.435258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.469898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-258937f1-f5b2-407c-b61e-ff8267c678ac tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.149606 Jul 20 19:26:48.473070 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 201/406] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:48 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:48.491998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-6e1921d8-816c-4d82-86d0-5667a0549969 req-9b09db22-c685-42d7-b9e5-d0e34cac319c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:26:48.500009 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-6e1921d8-816c-4d82-86d0-5667a0549969 req-9b09db22-c685-42d7-b9e5-d0e34cac319c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.500556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-6e1921d8-816c-4d82-86d0-5667a0549969 req-9b09db22-c685-42d7-b9e5-d0e34cac319c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.512129 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-6e1921d8-816c-4d82-86d0-5667a0549969 req-9b09db22-c685-42d7-b9e5-d0e34cac319c service nova] Creating event network-changed:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:26:48.521459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-6e1921d8-816c-4d82-86d0-5667a0549969 req-9b09db22-c685-42d7-b9e5-d0e34cac319c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033631 Jul 20 19:26:48.522474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 206/407] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:26:48.642947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:48.643719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:48.650824 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.651658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.652699 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:48.653351 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:48.803195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.829265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.831765 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:48.835352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-06514a40-3a31-4d1a-ab56-0c8a0c02f68a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.194321 Jul 20 19:26:48.836662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 202/408] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:48 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:49.490511 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:49.491572 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:49.498354 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.498833 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:49.499611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.500068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:49.592013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:49.595884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:49.602250 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bc6ecc79-8216-4aac-a280-3c0f6c7ea03e tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.116737 Jul 20 19:26:49.603470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 207/409] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:49 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:49.855893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:49.856518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:49.863640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.864082 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:49.864886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:49.865317 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.054496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.076098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.077921 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.079266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4c354d11-205a-40b8-b301-a050aceeec47 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.229276 Jul 20 19:26:50.086447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 203/410] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:49 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:50.619934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:50.621455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:50.630282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.631096 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.632093 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:50.632754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:50.707314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:50.719953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-74ba9232-9d68-487a-90aa-91ed4afd25a0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.104542 Jul 20 19:26:50.730938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 208/411] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:50 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:51.099232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:51.100933 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:51.108850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.109292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.110138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.110576 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.254496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:51.264853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:51.266413 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:51.267623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f6c2dd3a-9903-4642-afa2-fe867f184e96 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.172932 Jul 20 19:26:51.268224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 204/412] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:51 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:51.738026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:51.738628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:51.746990 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.747451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.748219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:51.748774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:51.815658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:51.823156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e9fe7629-9f78-41d3-95ab-93a073c8e022 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.089168 Jul 20 19:26:51.823720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 209/413] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:51 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:52.286443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:52.287087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:52.294445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.294915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.295781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.296332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.444304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:52.452704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:52.454218 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:52.455406 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1541206f-2bd7-42e3-afb6-e044d30c44dd tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.173017 Jul 20 19:26:52.456061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 205/414] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:52 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:52.839630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:52.840235 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:52.847324 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.847806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.848653 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:52.849169 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:52.920655 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:52.928219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fd6c162c-51b3-46bc-bf5d-74e61d69eb61 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.092654 Jul 20 19:26:52.928816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 210/415] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:52 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:53.473510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:53.474086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:53.481108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.481544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:53.482345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.482723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:53.622061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:53.639733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:53.642668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:53.644689 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b5b7e09b-44c2-4244-93a6-5ff5f6d30bd7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.174999 Jul 20 19:26:53.645721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 206/416] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:53 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:53.945939 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:53.946523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:53.952969 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.953409 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:53.954156 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:53.954587 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:54.019685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:54.028233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e0545344-3495-44c7-b608-c854788763df tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.086675 Jul 20 19:26:54.028850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 211/417] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:53 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:54.664235 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:54.665639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:54.672641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:54.674595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:54.675366 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:54.676474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:54.677123 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:54.820792 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:54.829324 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:54.830832 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:54.831981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b48f6aba-eafe-4570-a7c3-c78800891394 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.172405 Jul 20 19:26:54.832599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 207/418] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:54 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:55.046911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:55.048463 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:55.055851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.056898 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:55.058038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.058774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:55.124036 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:55.131683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-144c0b4e-a067-471a-89c0-7ca057009230 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.090498 Jul 20 19:26:55.132256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 212/419] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:55 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:55.849467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:55.850103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:55.856682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.857124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:55.857877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:55.858306 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:55.889462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:55.991045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:55.999272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:56.000812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:56.001967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d9398798-033e-4fa6-ad31-946d024cba0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.156532 Jul 20 19:26:56.002640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 208/420] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:55 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:56.148480 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:56.149046 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:56.155789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:56.156245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:56.157042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:56.157484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:56.219742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:56.227733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-259a35dc-3d25-4c36-8430-28267e32a2f3 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1219 microversion: 2.1 time: 0.083918 Jul 20 19:26:56.228333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 213/421] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:56 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:57.020013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:57.020652 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:57.022475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=8 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:57.028959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.029402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.030162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.030591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.183626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.192391 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.194763 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.195622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fa4e2525-dbd6-40d1-b0dc-ea40d5fbf4e8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.179629 Jul 20 19:26:57.196180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 209/422] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:57 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:57.244502 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:57.245109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:57.251409 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.251753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.252578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:57.253017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:57.317106 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:57.325132 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ea83c9b1-4a02-4218-a861-92073d1daa3f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1211 microversion: 2.1 time: 0.085034 Jul 20 19:26:57.325728 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 214/423] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:57 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:58.214585 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:58.215193 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:58.221996 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.222459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.223363 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.223805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.341963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:58.342619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:58.354177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.355414 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.356220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:58.356894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:58.360279 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.373755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.376533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.378560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ba8ea5dd-2d5f-4320-be2c-8859edcb4111 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.167680 Jul 20 19:26:58.379856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 210/424] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:58 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:26:58.429691 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:58.440611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-355bf0ae-e353-42a1-9afe-3a7090c569a1 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1211 microversion: 2.1 time: 0.102081 Jul 20 19:26:58.441382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 215/425] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:58 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:26:59.402408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:59.403118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:59.410018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.410459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.411227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.411658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.427105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:59.457751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:26:59.458347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:26:59.465087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.465530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.466301 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:26:59.466734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:26:59.529642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.537450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9b4f8fe0-4738-4f04-8a61-364974a88d54 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1273 microversion: 2.1 time: 0.083535 Jul 20 19:26:59.538023 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 216/426] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:26:59 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:26:59.548327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.558436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.559972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:26:59.561189 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6a5a289f-8630-499f-ba03-7496d5c7856e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.162813 Jul 20 19:26:59.561748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 211/427] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:26:59 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:00.555090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:00.555708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:00.562232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.562692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.563749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.564173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.589596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:00.590290 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:00.596852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.597087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.597775 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:00.598205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:00.626184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:00.635105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-20f1d341-a076-4f88-9d3e-052bf6d6c40c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1273 microversion: 2.1 time: 0.084488 Jul 20 19:27:00.635693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 217/428] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:00 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:00.729147 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:00.737398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:00.739788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:00.740031 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4696d9d9-60ed-4415-9a3b-895a16d15c24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.154332 Jul 20 19:27:00.741268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 212/429] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:00 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:01.652164 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:01.652759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:01.659983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:01.660476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:01.661254 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:01.661696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:01.726699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.734294 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5738b92b-7e63-4104-9d23-61bb9df7bcea tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1273 microversion: 2.1 time: 0.086062 Jul 20 19:27:01.734881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 218/430] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:01 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:01.758559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:01.759139 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:01.765635 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:01.766074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:01.766824 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:01.767267 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:01.900210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.908727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.910200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:01.911356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e3391dc3-7d4e-49bc-9535-aaf682020c0a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.156654 Jul 20 19:27:01.911928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 213/431] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:01 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:02.751197 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:02.751828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:02.759083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.760758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.760758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.761055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.931156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:02.931769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:02.938551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.939001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:02.939785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:02.940215 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.002425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.010861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6f44387f-c1f4-49e8-b9d1-191a0dc7fe46 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.263576 Jul 20 19:27:03.011452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 219/432] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:02 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:03.077172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.087919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.091011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:03.093229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6cb24fdf-00ab-4219-b0c2-95dcab7ec9af tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.166405 Jul 20 19:27:03.094308 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 214/433] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:02 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:03.378802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-e744760a-e498-45b8-a4da-85213f6db934 req-a628b303-17cd-41ba-8d3e-5280dfdc5297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0b05de-487c-4986-95f5-7ab30390edc4", "tag": "2156b056-21d9-45f7-afcb-c4c2bb7de07c"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:03.389267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-e744760a-e498-45b8-a4da-85213f6db934 req-a628b303-17cd-41ba-8d3e-5280dfdc5297 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:03.389716 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-e744760a-e498-45b8-a4da-85213f6db934 req-a628b303-17cd-41ba-8d3e-5280dfdc5297 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:03.401461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-e744760a-e498-45b8-a4da-85213f6db934 req-a628b303-17cd-41ba-8d3e-5280dfdc5297 service nova] Creating event network-changed:2156b056-21d9-45f7-afcb-c4c2bb7de07c for instance 4b0b05de-487c-4986-95f5-7ab30390edc4 on hv-cinder-81914 Jul 20 19:27:03.406723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-e744760a-e498-45b8-a4da-85213f6db934 req-a628b303-17cd-41ba-8d3e-5280dfdc5297 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031582 Jul 20 19:27:03.407330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 220/434] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:04.027051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:04.027651 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:04.034575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.035022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.035786 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.036217 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.113269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:04.113977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:04.121037 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.121718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.122501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:04.122940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:04.172357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:04.186110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bc64f6af-78a1-4e99-b2f8-89cc4b4f58ff tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.162794 Jul 20 19:27:04.186798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 215/435] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:04 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:04.291487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:04.300265 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:04.301826 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:04.303570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-105ba66b-2cf7-4488-879f-b33f059159de tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.193970 Jul 20 19:27:04.304812 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 221/436] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:04 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:05.207514 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:05.208678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:05.218821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.219352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.220123 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.220584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.324316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:05.325013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:05.335769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.336227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.337305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:05.337750 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:05.382664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:05.391420 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-756eef0c-d787-4139-9dca-d725f50ae3f7 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.188254 Jul 20 19:27:05.392369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 216/437] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:05 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:05.485591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:05.494695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:05.496388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:05.497545 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d43cdfdc-7f5a-4f73-b819-9d02b85d0251 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.177259 Jul 20 19:27:05.498115 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 222/438] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:05 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:06.408805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:06.409995 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:06.416792 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.417235 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.417999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.418424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.516449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:06.517669 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:06.524893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.525630 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.526411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:06.526847 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:06.554633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:06.562912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8d10b1c0-0071-4866-aa81-da7bac9622b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.157878 Jul 20 19:27:06.563874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 217/439] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:06 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:06.685461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:06.707950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:06.709483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:06.710800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bf7fc113-5c61-415b-b62a-48414403897c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.198404 Jul 20 19:27:06.711352 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 223/440] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:06 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:07.580664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:07.581243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:07.588077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:07.588553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:07.589311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:07.589740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:07.729729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:07.730290 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:07.731184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:07.737495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b8699eb1-b6c1-4546-af0c-9c5a56f6740c tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.161078 Jul 20 19:27:07.738075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 218/441] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:07 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:07.738971 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:07.739503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:07.740336 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:07.740781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:07.873384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:07.881829 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:07.883347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:07.884529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-57b248b6-b13d-4bb8-a7d7-32e85c8e6b1d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.158099 Jul 20 19:27:07.885087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 224/442] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:07 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:08.754733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:08.755272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:08.762752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.763028 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.763801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.764232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.898551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:08.902984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:08.903580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:08.906200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cd3ba479-a27d-403d-b089-11cffd3586b0 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.155329 Jul 20 19:27:08.906793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 219/443] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:08 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:08.910291 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.910735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.911623 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:08.912057 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:08.916841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:09.048500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:09.058043 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:09.059571 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:09.060763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-550b5430-b1e1-4a2f-9b71-45f05059bc24 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.161818 Jul 20 19:27:09.061325 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 225/444] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:08 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:09.924035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:09.924655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:09.931738 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:09.932182 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:09.932987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:09.933421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:10.060105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:10.067872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cdc13c88-2cd8-4add-b94e-6721ccb4d275 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.147633 Jul 20 19:27:10.068470 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 220/445] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:09 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:10.078918 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:10.079542 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:10.087113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:10.087573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:10.088376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:10.088822 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:10.226121 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:10.234744 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:10.236277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:10.237475 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-34fa0d6c-e1c1-4d91-a68c-f65d132feb72 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.162472 Jul 20 19:27:10.238042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 226/446] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:10 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:11.087278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:11.088034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:11.094539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.094980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.095858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.096167 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.241398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:11.250270 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0b61f5ad-0818-4b06-87f4-52ad4971b3b5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.168742 Jul 20 19:27:11.257236 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:11.257851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:11.261019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 221/447] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:11 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:11.265290 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.265749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.266606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:11.267361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:11.440178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:11.449447 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:11.451051 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:11.452534 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2b1f943b-23fc-4b95-8023-24ad297f4fdb tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.200824 Jul 20 19:27:11.453179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 227/448] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:11 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:12.274948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:12.276417 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:12.292542 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.293305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.294721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.295478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.482486 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:12.485635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:12.514716 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.516704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.518041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.518801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.747935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:12.763672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:12.766699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:12.769892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b774a47d-3823-416d-bada-9fc31a9f6997 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.299951 Jul 20 19:27:12.770801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 228/449] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:12 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:12.778161 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-f1cf695c-5831-4dbb-a4d7-2a872d91fec3 req-e2f432a8-4df2-4b9b-bf37-f1e4f8ceea18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "name": "network-vif-plugged", "status": "completed", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:12.788893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-f1cf695c-5831-4dbb-a4d7-2a872d91fec3 req-e2f432a8-4df2-4b9b-bf37-f1e4f8ceea18 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:12.789389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-f1cf695c-5831-4dbb-a4d7-2a872d91fec3 req-e2f432a8-4df2-4b9b-bf37-f1e4f8ceea18 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:12.803232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-f1cf695c-5831-4dbb-a4d7-2a872d91fec3 req-e2f432a8-4df2-4b9b-bf37-f1e4f8ceea18 service nova] Creating event network-vif-plugged:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:27:12.809030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-f1cf695c-5831-4dbb-a4d7-2a872d91fec3 req-e2f432a8-4df2-4b9b-bf37-f1e4f8ceea18 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036876 Jul 20 19:27:12.809874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 229/450] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:12.819851 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:12.830487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-913953c1-5ad9-427a-bd25-82604403d738 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.565937 Jul 20 19:27:12.831089 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 222/451] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:12 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:13.789759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:13.790906 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:13.797729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.798261 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:13.799138 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.799712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:13.847516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:13.848623 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:13.859425 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.859876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:13.860674 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:13.861319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:13.962904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:13.971671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:13.973320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:13.974570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-117e0332-bf57-48fc-9725-3f7df6a11542 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.190025 Jul 20 19:27:13.975267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 230/452] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:13 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:14.052681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:14.060842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b89aa993-d52b-4bb0-8f75-00a5e0a1beb2 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.217700 Jul 20 19:27:14.061404 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 223/453] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:13 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:14.832582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-e8bb4694-df78-4ff2-bfde-d218b2813227 req-9c5c7d5e-89bd-4ccc-b4ec-97fba0a6ca53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0b05de-487c-4986-95f5-7ab30390edc4", "name": "network-vif-plugged", "status": "completed", "tag": "2156b056-21d9-45f7-afcb-c4c2bb7de07c"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:14.842383 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-e8bb4694-df78-4ff2-bfde-d218b2813227 req-9c5c7d5e-89bd-4ccc-b4ec-97fba0a6ca53 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:14.842835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-e8bb4694-df78-4ff2-bfde-d218b2813227 req-9c5c7d5e-89bd-4ccc-b4ec-97fba0a6ca53 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:14.855283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-e8bb4694-df78-4ff2-bfde-d218b2813227 req-9c5c7d5e-89bd-4ccc-b4ec-97fba0a6ca53 service nova] Creating event network-vif-plugged:2156b056-21d9-45f7-afcb-c4c2bb7de07c for instance 4b0b05de-487c-4986-95f5-7ab30390edc4 on hv-cinder-81914 Jul 20 19:27:14.860159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-e8bb4694-df78-4ff2-bfde-d218b2813227 req-9c5c7d5e-89bd-4ccc-b4ec-97fba0a6ca53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Jul 20 19:27:14.860733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 231/454] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:14.993250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:14.993874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:15.000203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.000679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.001430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.001858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.078467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:15.078999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:15.086004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.086450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.087212 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:15.087643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:15.134066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:15.142395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:15.144165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:15.145368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d0f0dc6a-21e0-4b7b-b09e-c89be849070b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.156130 Jul 20 19:27:15.145930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 224/455] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:14 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:27:15.222173 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:15.230109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9ca59ff7-d481-48ed-ad58-82ee414bb50a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.155934 Jul 20 19:27:15.230677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 232/456] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:15 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:16.165395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:16.167303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:16.174405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.174849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.175622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.176077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.247055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:16.247871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:16.254489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.254934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.255778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:16.256246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:16.319918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:16.328654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:16.330558 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:16.332327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fad77043-b97e-4b66-925c-10292baa5709 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1809 microversion: 2.20 time: 0.171829 Jul 20 19:27:16.336692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 225/457] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:16 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:16.417070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:16.426780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-60000197-7236-4973-941b-94d51f347e8a tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1315 microversion: 2.1 time: 0.183638 Jul 20 19:27:16.427426 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 233/458] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:16 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:17.351289 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:17.352533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:17.358613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.359055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.359830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.360252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.451848 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:17.452505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:17.455165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=60 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:17.460687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.461139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.461910 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.462347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.491171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.500090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.501666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.502836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dcab6a9c-4143-4a86-8e48-c90c679ad2aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1796 microversion: 2.20 time: 0.155561 Jul 20 19:27:17.503409 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 226/459] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:17 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:17.590979 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.598410 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7930fff2-29ac-45b0-8093-bb67371ee892 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1465 microversion: 2.1 time: 0.150424 Jul 20 19:27:17.598979 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 234/460] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:17 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:17.637337 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:17.637826 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:17.643827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.644277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.645111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.645583 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.670417 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:27:17.684565 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:17.747292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e975c9fc-b201-4f9c-bd6c-32cfed6ec10f tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 204 len: 0 microversion: 2.1 time: 0.113498 Jul 20 19:27:17.748144 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 227/461] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:27:17 2022] DELETE /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:27:17.756987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:17.757689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:17.763797 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.764251 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.765041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:17.765479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:17.893998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:17.901631 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-94002b05-6069-49a2-b9cd-dd1a5f9ada77 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1471 microversion: 2.1 time: 0.149243 Jul 20 19:27:17.902200 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 235/462] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:17 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:18.919171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:18.919852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:18.926341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:18.926780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:18.927526 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:18.928557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:19.058112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:19.065810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8a51580f-b4ef-425b-aa6f-e549fdaf3a9d tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1471 microversion: 2.1 time: 0.150820 Jul 20 19:27:19.066379 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 228/463] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:18 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:19.727275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-53838143-3f8c-4f14-a240-b0f8b77c0df4 req-6f392c81-3d2c-4973-8e38-856f8169cb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0b05de-487c-4986-95f5-7ab30390edc4", "name": "network-vif-deleted", "tag": "2156b056-21d9-45f7-afcb-c4c2bb7de07c"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:19.736382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-53838143-3f8c-4f14-a240-b0f8b77c0df4 req-6f392c81-3d2c-4973-8e38-856f8169cb47 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:19.736832 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-53838143-3f8c-4f14-a240-b0f8b77c0df4 req-6f392c81-3d2c-4973-8e38-856f8169cb47 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:19.754280 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-53838143-3f8c-4f14-a240-b0f8b77c0df4 req-6f392c81-3d2c-4973-8e38-856f8169cb47 service nova] Creating event network-vif-deleted:2156b056-21d9-45f7-afcb-c4c2bb7de07c for instance 4b0b05de-487c-4986-95f5-7ab30390edc4 on hv-cinder-81914 Jul 20 19:27:19.759442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-53838143-3f8c-4f14-a240-b0f8b77c0df4 req-6f392c81-3d2c-4973-8e38-856f8169cb47 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036483 Jul 20 19:27:19.760048 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 236/464] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:20.083378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:20.083979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:20.091040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:20.091481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:20.092229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:20.092680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:20.121902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:20.122338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:20.122770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lazy-loading 'fault' on Instance uuid 4b0b05de-487c-4986-95f5-7ab30390edc4 {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:27:20.163527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1ceda5bed824184b10bfaff48ee006c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2765674134b8415f8ab79fc7295fbe1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:20.172875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-206c3267-0c52-4618-81cf-3c450859a768 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 200 len: 1305 microversion: 2.1 time: 0.093243 Jul 20 19:27:20.173849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 229/465] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:20 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:21.191819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:21.192458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] [instance: 4b0b05de-487c-4986-95f5-7ab30390edc4] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:21.198614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:21.199062 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:21.199818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:21.200258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:21.213769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] HTTP exception thrown: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Request method failure captured: Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 HTTP/1.1 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2Fbpy9_KCbuxWU4BbZIGJe6WpYpweucVUPI0cF-Mm41fDW51VlJfafVVToajaGEwzh3uuuLxOE69925rV-uuCk6oOSQexgrrZljwSLuvPLFnrvPK6xhNT6FgoyZFzEq7uIfgRHaqFztnIg9SWevBwWYt9Hm5t8F5nWu5ZyqVANamCJ8 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 2765674134b8415f8ab79fc7295fbe1d Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesNegativeTest-485561785 Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:27:21.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2765674134b8415f8ab79fc7295fbe1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2765674134b8415f8ab79fc7295fbe1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2765674134b8415f8ab79fc7295fbe1d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2765674134b8415f8ab79fc7295fbe1d"}]}] Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesNegativeTest-485561785 Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 2765674134b8415f8ab79fc7295fbe1d Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesNegativeTest-485561785 Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesNegativeTest-485561785-project Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: a1ceda5bed824184b10bfaff48ee006c Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesNegativeTest-485561785-project Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. Jul 20 19:27:21.216930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '4b0b05de-487c-4986-95f5-7ab30390edc4'} Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:27:21.217801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. Jul 20 19:27:21.219231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:27:21.220385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] Returning 404 to user: Instance 4b0b05de-487c-4986-95f5-7ab30390edc4 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:27:21.220385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6d9b3564-3036-4909-82e2-40728f7c9bf5 tempest-VolumesNegativeTest-485561785 tempest-VolumesNegativeTest-485561785-project] 10.222.0.43 "GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4" status: 404 len: 111 microversion: 2.1 time: 0.029955 Jul 20 19:27:21.220385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 237/466] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:21 2022] GET /compute/v2.1/servers/4b0b05de-487c-4986-95f5-7ab30390edc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:27:25.855097 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:27:25.855574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Wed Jul 20 19:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:27:27.376799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:27.377590 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:27.379586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:27.386246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:27.386755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:27.387567 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:27.388008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:27.529470 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lazy-loading 'services' on Instance uuid 58f977b5-705c-46e5-b597-311c97d2edea {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:27:27.646133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2d9920a7-8a83-4194-90b0-57e6d8f45a3f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments/dbe8e07a-9d4f-4ee2-aadd-1e6573e8267d" status: 202 len: 0 microversion: 2.1 time: 0.273930 Jul 20 19:27:27.647673 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 230/467] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:27:27 2022] DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments/dbe8e07a-9d4f-4ee2-aadd-1e6573e8267d => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:27:31.924937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bddcb5d3-cbde-439b-95e0-0f69b1d73bb4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:31.927377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=7 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:31.928543 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=60 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:31.934553 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bddcb5d3-cbde-439b-95e0-0f69b1d73bb4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:31.935001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bddcb5d3-cbde-439b-95e0-0f69b1d73bb4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:31.957829 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bddcb5d3-cbde-439b-95e0-0f69b1d73bb4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Going to try to stop instance {{(pid=117768) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 19:27:32.004323 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bddcb5d3-cbde-439b-95e0-0f69b1d73bb4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action" status: 202 len: 0 microversion: 2.1 time: 0.082839 Jul 20 19:27:32.004953 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 238/468] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:27:31 2022] POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:27:32.016045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:32.017399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:32.027288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:32.027944 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:32.029099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:32.029759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:32.164654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:32.173232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bccab8a9-f0fc-45de-a1fa-abd36a949210 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.162283 Jul 20 19:27:32.173792 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 231/469] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:32 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:33.192730 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:33.194580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:33.203077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:33.203077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:33.203077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:33.203077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:33.335062 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:33.342944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dccd14b9-969b-4a57-b800-ed2efacdd916 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.155148 Jul 20 19:27:33.343450 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 239/470] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:33 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:34.360157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:34.360857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:34.367788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:34.368232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:34.369019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:34.369461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:34.502234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:34.509935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3249e400-ee43-4200-a7c8-dda2fde39438 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.153531 Jul 20 19:27:34.510498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 232/471] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:34 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:35.527509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:35.528103 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:35.535015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:35.535470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:35.536257 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:35.536927 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:35.675149 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:35.683397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-22015454-1fb1-4ffe-a9a0-534b18dd44a9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.159753 Jul 20 19:27:35.683959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 240/472] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:35 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:36.703206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:36.703989 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:36.710537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:36.711027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:36.711825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:36.712259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:36.847504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:36.857130 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c166b9da-7b6d-4bcb-8707-e48ba5c16a58 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.157980 Jul 20 19:27:36.857705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 233/473] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:36 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:37.874576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:37.875179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:37.882423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:37.882843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:37.883609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:37.884041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:38.013021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:38.020542 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-375e1ef0-0db7-4192-9e65-82c78ca39c78 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.149976 Jul 20 19:27:38.021108 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 241/474] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:37 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:39.038239 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:39.038845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:39.045360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:39.045808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:39.046568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:39.047000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:39.175037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:39.183286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dd8f7f82-51e1-4bfc-9d5a-192d0cff1a2b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.149397 Jul 20 19:27:39.183855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 234/475] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:39 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:40.199648 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:40.200249 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:40.206828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:40.207294 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:40.208066 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:40.208528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:40.339629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:40.347239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8a8987e8-97dd-4c1d-82c4-76faa7b9165d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.151425 Jul 20 19:27:40.347805 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 242/476] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:40 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:41.364278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:41.364941 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:41.372263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:41.372762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:41.373642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:41.373992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:41.529481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:41.537628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c1df5264-62e6-4f98-9bc8-80cab226e035 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1677 microversion: 2.1 time: 0.177341 Jul 20 19:27:41.538202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 235/477] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:41 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:42.555005 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:42.555726 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:42.562455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:42.562928 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:42.563948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:42.564407 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:42.696753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:42.704321 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-988b5fe5-92b2-4fe7-9b14-02dc5b561642 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1654 microversion: 2.1 time: 0.153190 Jul 20 19:27:42.704901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 243/478] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:42 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:42.720549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9b49de39-7e9c-433b-bdc3-3ca1050ecec2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:42.727628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9b49de39-7e9c-433b-bdc3-3ca1050ecec2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:42.728071 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9b49de39-7e9c-433b-bdc3-3ca1050ecec2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:42.750158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9b49de39-7e9c-433b-bdc3-3ca1050ecec2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Going to try to start instance {{(pid=117769) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 19:27:42.792994 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9b49de39-7e9c-433b-bdc3-3ca1050ecec2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action" status: 202 len: 0 microversion: 2.1 time: 0.076078 Jul 20 19:27:42.793632 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 236/479] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:27:42 2022] POST /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:27:42.801790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:42.802402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:42.809482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:42.809792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:42.810398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:42.810840 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:43.022202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:43.029915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0d12ba36-820f-432f-9f4c-062149e83197 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1663 microversion: 2.1 time: 0.231971 Jul 20 19:27:43.030493 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 244/480] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:42 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1663 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:43.882770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fbaeeb1-5ca3-48b4-8217-5b84f715ae48"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:43.883958 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:43.890188 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:43.890628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:43.891399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:43.891898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:44.047263 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:44.047868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:44.054581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:44.055031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:44.055794 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:44.056229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:44.190329 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:44.198580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-10da3944-bcf0-418f-9a2f-f6a8230bf1a2 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1663 microversion: 2.1 time: 0.155157 Jul 20 19:27:44.199160 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 245/481] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:44 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:44.615803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bdb081ee-3e70-48d0-8d8d-70fc91e451b2 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737715 Jul 20 19:27:44.616812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 237/482] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:27:43 2022] POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:27:45.216973 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:45.217578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:45.224386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:45.224833 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:45.225599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:45.226034 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:45.371296 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:45.378714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4f712348-d38d-4de7-b63d-17b43b052b77 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1667 microversion: 2.1 time: 0.165824 Jul 20 19:27:45.379274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 246/483] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:45 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:52.109387 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:27:52.110413 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:52.116585 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:52.117070 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:52.117869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:52.118309 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:52.121967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:52.142759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'flavor' on Instance uuid 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:27:52.263555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9c93d773-2c25-4cdc-a4f9-1b7d700968bf tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/action" status: 200 len: 32 microversion: 2.1 time: 0.159255 Jul 20 19:27:52.264090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 238/484] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:27:52 2022] POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:27:52.273056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:52.274421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:52.280995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:52.281431 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:52.282191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:52.282624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:52.495316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:52.503194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2fbd4471-4497-4a59-b9de-6f679ce9e6fc tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.233847 Jul 20 19:27:52.503773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 247/485] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:52 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:53.521541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:53.522231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:53.528870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:53.529316 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:53.530074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:53.530503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:53.659118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:53.667912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-734d81cd-8a1f-4baa-a9fb-2b32c9aba9d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.151316 Jul 20 19:27:53.668507 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 239/486] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:53 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:54.685582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:54.686133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:54.692553 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:54.693006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:54.693769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:54.694208 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:54.818799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:54.826755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-35a286fa-3237-4088-b27d-ee1b3310f51f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.145419 Jul 20 19:27:54.827318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 248/487] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:54 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:55.843858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:55.844538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:55.851112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:55.852127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:55.852905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:55.853334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:55.983668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:55.991598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-52f9ba54-9054-4df5-bc6c-1d1d1908af80 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.151833 Jul 20 19:27:55.992242 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 240/488] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:55 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:56.818899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:56.819481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:56.825845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:56.826290 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:56.827047 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:56.827485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:56.858551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c7eb296d-5ac3-4cb7-ac45-0e258a01cdf1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments/d23a7c44-b718-48d1-8a55-59dfbf2e67cd" status: 200 len: 194 microversion: 2.20 time: 0.043732 Jul 20 19:27:56.859134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 249/489] 10.222.0.43 () {60 vars in 1453 bytes} [Wed Jul 20 19:27:56 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments/d23a7c44-b718-48d1-8a55-59dfbf2e67cd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:27:56.920093 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:56.920701 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:56.926954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:56.927394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:56.928169 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:56.928635 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:57.009031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:57.009520 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lazy-loading 'services' on Instance uuid b30e5793-20b0-4600-b897-6f3c2de29b83 {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:27:57.009633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:57.015545 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:57.015995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:57.016792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:57.017226 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:57.081028 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-005d8364-1d97-463a-9727-82cb31271047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments/d23a7c44-b718-48d1-8a55-59dfbf2e67cd" status: 202 len: 0 microversion: 2.20 time: 0.164000 Jul 20 19:27:57.081028 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 241/490] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jul 20 19:27:56 2022] DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments/d23a7c44-b718-48d1-8a55-59dfbf2e67cd => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:27:57.090332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:57.091360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:57.097967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:57.098543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:57.099359 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:57.099788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:57.131548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-19e631bd-3033-451e-9b4e-9a0e615b465d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045770 Jul 20 19:27:57.133072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 242/491] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 19:27:57 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:27:57.153377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:57.161465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4b928930-5385-4c2c-a4ed-af509bd3a4b6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.156267 Jul 20 19:27:57.162207 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 250/492] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:57 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:58.143196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:58.144098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:58.146490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=26 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:58.151599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.152038 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.152814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.153237 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.178871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:58.179482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:58.184051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d9c1170e-8a12-42d8-a7c4-e1a6075ee761 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044793 Jul 20 19:27:58.184648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 243/493] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 19:27:58 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:58.186803 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.187248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.188014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.188478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.241992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:58.242481 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:58.249097 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.249544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.250305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.250742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.275292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:27:58.326852 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:58.335854 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ecaabfd7-9a30-462f-9c32-f77e908acfc1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.160740 Jul 20 19:27:58.336693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 251/494] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:58 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:27:58.356378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d3a941be-cccb-4555-bc46-be9180b6b28a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 204 len: 0 microversion: 2.20 time: 0.117919 Jul 20 19:27:58.356999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 244/495] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 19:27:58 2022] DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 19:27:58.366211 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:58.366814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:58.373699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.374153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.374909 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:58.375345 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:58.502242 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:58.510165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:58.511689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:58.512915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0a9e0c27-7243-4518-a2f7-cb18c3776f67 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.151716 Jul 20 19:27:58.513479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 252/496] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:58 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:27:59.353848 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:59.354563 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:59.360930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:59.361371 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:59.362150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:59.362574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:59.488902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:59.497306 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8797c09a-c278-4982-b0ad-e3f9667d3b22 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.147775 Jul 20 19:27:59.497898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 245/497] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:27:59 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:27:59.530814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:27:59.531550 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:27:59.538070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:59.538524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:59.539292 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:27:59.539734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:27:59.557978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:59.671268 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:59.679176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:59.681222 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:27:59.682383 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d844d752-010f-4856-a4e5-6cd979207ca6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1724 microversion: 2.20 time: 0.155453 Jul 20 19:27:59.682947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 253/498] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:27:59 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:00.514062 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:00.514665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:00.521042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:00.521491 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:00.522253 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:00.522686 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:00.657128 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:00.667751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-21eaf5e9-7e53-4504-a5a3-5e30a3e4e93f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.155040 Jul 20 19:28:00.670553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 246/499] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:00 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:00.701775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:00.702382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:00.709491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:00.709945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:00.710737 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:00.711180 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:00.986025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:00.993962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:00.995484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:00.996654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f52ac165-85ff-4652-9f4a-4557bdfc68a4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 200 len: 1656 microversion: 2.20 time: 0.299010 Jul 20 19:28:00.997398 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 254/500] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:00 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 1656 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:01.163255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-270cadb3-8b6c-4ff2-a035-3a90783dcb80 req-117f54a9-bf1f-4cd1-934f-713ff508aefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30e5793-20b0-4600-b897-6f3c2de29b83", "name": "network-vif-deleted", "tag": "61e3f31b-7885-4b43-8167-c676cd576b57"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:01.176564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-270cadb3-8b6c-4ff2-a035-3a90783dcb80 req-117f54a9-bf1f-4cd1-934f-713ff508aefd service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:01.177010 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-270cadb3-8b6c-4ff2-a035-3a90783dcb80 req-117f54a9-bf1f-4cd1-934f-713ff508aefd service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:01.190873 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-270cadb3-8b6c-4ff2-a035-3a90783dcb80 req-117f54a9-bf1f-4cd1-934f-713ff508aefd service nova] Creating event network-vif-deleted:61e3f31b-7885-4b43-8167-c676cd576b57 for instance b30e5793-20b0-4600-b897-6f3c2de29b83 on hv-cinder-81914 Jul 20 19:28:01.200224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-270cadb3-8b6c-4ff2-a035-3a90783dcb80 req-117f54a9-bf1f-4cd1-934f-713ff508aefd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039405 Jul 20 19:28:01.201172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 247/501] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:01.689500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:01.690963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:01.698849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:01.699467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:01.700306 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:01.701617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:01.859838 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:01.868715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c3a517e8-8913-4e2a-bf56-ed8472340621 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.184640 Jul 20 19:28:01.869896 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 255/502] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:01 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:02.015871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:02.016913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:02.024418 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:02.024876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:02.025648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:02.026086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:02.043793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 HTTP/1.1 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:28:02.045191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:28:02.047032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'b30e5793-20b0-4600-b897-6f3c2de29b83'} Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:28:02.047962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:28:02.049464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:02.050795 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:28:02.051352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-53253c06-d237-48eb-ae37-6dcc13888ce6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 404 len: 111 microversion: 2.20 time: 0.039955 Jul 20 19:28:02.052224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 248/503] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:02 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:28:02.061036 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f16351a5-a8b5-45b0-b182-4f12e79daaee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '.version_select at 0x7f26c15ec9d0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:02.067338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=37 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:02.082189 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f16351a5-a8b5-45b0-b182-4f12e79daaee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-701008186" status: 204 len: 0 microversion: 2.20 time: 0.024992 Jul 20 19:28:02.082824 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 256/504] 10.222.0.43 () {60 vars in 1258 bytes} [Wed Jul 20 19:28:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-701008186 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:28:02.743594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8edd3e38-f7be-429a-a29f-584fca7f5732 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: .version_select at 0x7f26c15deaf0>, body: {"keypair": {"name": "tempest-keypair-1644020211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFKyUXo0aJQoxIk1s2DuyX3fE22oSCSaxo8pc+s24BVte8rqSHIZJLGSm5/nN0b7aWd+gvy7GJIN8ATCgPv5ngdaniZIwJ/lZUSR3MxaZkoNtJHJ2SFTYytfKZW4LxLwg=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:02.759078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-8edd3e38-f7be-429a-a29f-584fca7f5732 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for project ff9c443652a141d482130869ff76c327. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:02.763171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-8edd3e38-f7be-429a-a29f-584fca7f5732 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for user 9ac790383bdf4eecaef96cc25fe38553 and project ff9c443652a141d482130869ff76c327. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:02.790715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8edd3e38-f7be-429a-a29f-584fca7f5732 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050576 Jul 20 19:28:02.791439 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 249/505] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jul 20 19:28:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 19:28:02.890572 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:02.891488 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:02.902009 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:02.902614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:02.904326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:02.904889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:03.051099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:03.062525 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4a1b6c01-6632-4d1f-9a37-2192d155ebb3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.179307 Jul 20 19:28:03.073459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 257/506] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:02 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:04.080991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:04.081579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:04.088349 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:04.088802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:04.089911 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:04.090355 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:04.095520 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-210678995", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab609c42-592c-4da6-88a0-b462f1083b16"}], "security_groups": [{"name": "tempest-securitygroup--257426075"}], "key_name": "tempest-keypair-1644020211", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:04.198845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] validate_networks() for [('ab609c42-592c-4da6-88a0-b462f1083b16', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:04.222776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:04.231314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d4fb0d28-9aad-41a0-b5fd-d5fed409f4a6 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.155047 Jul 20 19:28:04.231885 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 250/507] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:04 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:04.555185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:04.555614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:04.556087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:04.556658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:04.557073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:04.566965 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:04.567421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:04.568229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:04.568704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:04.586191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for project ff9c443652a141d482130869ff76c327. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:04.590801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Getting quotas for user 9ac790383bdf4eecaef96cc25fe38553 and project ff9c443652a141d482130869ff76c327. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:04.602359 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:04.604604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:04.654662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2497f492-a5a4-4d1a-a4b3-2986e9557f63 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.563375 Jul 20 19:28:04.656328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 258/508] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jul 20 19:28:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 19:28:04.665590 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:04.666272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:04.725388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:04.733076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:04.735001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:04.736278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5eafaa2b-640b-4226-8080-a471c25945c8 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1281 microversion: 2.20 time: 0.074681 Jul 20 19:28:04.736855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 251/509] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:04 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:05.248754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:05.249375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:05.256834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:05.257286 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:05.258059 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:05.258501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:05.387421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:05.395928 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-87f9336b-8a7e-4655-a50d-345f40d37664 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.151690 Jul 20 19:28:05.396547 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 259/510] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:05 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:05.754506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:05.755127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:05.762912 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:05.763356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:05.764146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:05.764688 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:05.825033 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:05.833060 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:05.834559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:05.835711 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9bbf288d-6711-4b0d-8a54-f4f398e95a8c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1339 microversion: 2.20 time: 0.085193 Jul 20 19:28:05.836265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 252/511] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:05 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:06.417606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:06.418794 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:06.426376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.427760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:06.428787 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.429868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:06.706355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:06.715142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c8928bbc-0b6c-4adb-a5a8-3edd2542f3e1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.304551 Jul 20 19:28:06.715930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 260/512] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:06 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:06.855014 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:06.855664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:06.861981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.862427 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:06.863194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:06.863626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:07.007330 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:07.009731 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:07.018414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:07.019940 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:07.021117 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-260fb540-3d85-4714-8a68-8ee948fcb19a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.170496 Jul 20 19:28:07.021998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 253/513] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:06 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:07.095350 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-91cdef47-e6c8-4163-b6ec-b9339c58a703 req-95519c29-2c24-413e-9ac6-2dc49031c196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:07.106845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-91cdef47-e6c8-4163-b6ec-b9339c58a703 req-95519c29-2c24-413e-9ac6-2dc49031c196 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:07.107295 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-91cdef47-e6c8-4163-b6ec-b9339c58a703 req-95519c29-2c24-413e-9ac6-2dc49031c196 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:07.120609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-91cdef47-e6c8-4163-b6ec-b9339c58a703 req-95519c29-2c24-413e-9ac6-2dc49031c196 service nova] Creating event network-changed:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:28:07.129421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-91cdef47-e6c8-4163-b6ec-b9339c58a703 req-95519c29-2c24-413e-9ac6-2dc49031c196 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037713 Jul 20 19:28:07.130333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 261/514] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:07.732883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:07.733399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:07.740279 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:07.740749 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:07.741519 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:07.741946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:07.876304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:07.884261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f5380e68-a9d6-4c18-aee7-40c091c74a90 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.155914 Jul 20 19:28:07.884854 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 254/515] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:07 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:08.039858 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:08.040489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:08.047227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.047673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.048468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.048916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.175809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:08.184273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:08.185820 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:08.186922 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d83c4ab5-f78a-42e5-8eb7-af0bcab1ea42 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.151858 Jul 20 19:28:08.187481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 262/516] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:08 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:08.902405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:08.902932 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:08.909366 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.909816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:08.910562 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:08.910991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:09.041310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:09.049465 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e1fe56d2-5785-420c-be4f-3622901f8d8f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.151555 Jul 20 19:28:09.050032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 255/517] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:08 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:09.204554 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:09.205240 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:09.211643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:09.212102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:09.212913 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:09.213360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:09.339326 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:09.347541 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:09.349289 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:09.350399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b46a36f6-e54f-4964-bc18-d1c71b475443 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.149880 Jul 20 19:28:09.350951 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 263/518] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:09 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:10.067133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:10.067816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:10.074141 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:10.074585 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:10.075341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:10.075767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:10.206680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:10.215086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2f2a949f-21b4-4e6d-acb4-7dfc1d87a093 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.152024 Jul 20 19:28:10.215649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 256/519] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:10 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:10.368187 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:10.368822 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:10.375228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:10.375672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:10.376449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:10.376955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:10.506922 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:10.515524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:10.517329 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:10.518311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a0d4a69c-f759-4d27-9c05-f795cf2d7348 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.154013 Jul 20 19:28:10.518888 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 264/520] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:10 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:10.631455 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-8491b0a9-5d3c-4b74-bfda-f7537ce845ee req-25d550c0-a2b3-4a40-a8d1-98aa2e426cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "name": "network-vif-plugged", "status": "completed", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:10.640526 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8491b0a9-5d3c-4b74-bfda-f7537ce845ee req-25d550c0-a2b3-4a40-a8d1-98aa2e426cb1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:10.640989 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-8491b0a9-5d3c-4b74-bfda-f7537ce845ee req-25d550c0-a2b3-4a40-a8d1-98aa2e426cb1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:10.652495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-8491b0a9-5d3c-4b74-bfda-f7537ce845ee req-25d550c0-a2b3-4a40-a8d1-98aa2e426cb1 service nova] Creating event network-vif-plugged:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:28:10.657264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-8491b0a9-5d3c-4b74-bfda-f7537ce845ee req-25d550c0-a2b3-4a40-a8d1-98aa2e426cb1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029587 Jul 20 19:28:10.657855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 257/521] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:11.231880 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:11.232510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:11.238592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.239045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.239806 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.240237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.372747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:11.386869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-28c2f69b-eaf6-4dcb-bd90-28586906ac8d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1733 microversion: 2.1 time: 0.159127 Jul 20 19:28:11.397148 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 265/522] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:11 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:11.538040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:11.538641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:11.545869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.546348 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.547121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:11.547544 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:11.677190 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:11.685079 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:11.686582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:11.687677 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-31ec3e87-6a8a-413a-8c0e-fa26ae0082c7 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.154433 Jul 20 19:28:11.688228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 258/523] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:11 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:12.404005 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:12.404662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.411529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.411980 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.412789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.413288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.540727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.549223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c9633abb-a64f-47cf-beca-2daed996c676 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1713 microversion: 2.1 time: 0.149034 Jul 20 19:28:12.549791 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 266/524] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:12 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:12.651106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:12.651633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.657981 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.658419 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.659164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.659593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.705537 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:12.706143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.712084 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.712570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.713335 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.713772 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.741226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] HTTP exception thrown: Cannot 'detach_volume' instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f while it is in vm_state rescued Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Request method failure captured: Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments/7fbaeeb1-5ca3-48b4-8217-5b84f715ae48 HTTP/1.1 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZIvF9ugpYe7-0EakHvix28xoFUPQn3x00w9KlsVzx0MTq9fViqd6xYxIRuVykPcSdM1tmeO8WbrYvngtZjMNZUDCwo9vCvRY7cqq20wFulaUk9Q9wgJPdKIVPxV2mqDDKlGy4LzA80A3dKZgYxMkIipqBj12PxR2ekvxmnIcoYR20 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:28:12.742863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0f63357734c4efa9a88c07996aa5551", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}] Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: cb06eeba738b452fab3986de7e1f7856 Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:28:12.746901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Cannot 'detach_volume' instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f while it is in vm_state rescued Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'server_id': '0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f', 'id': '7fbaeeb1-5ca3-48b4-8217-5b84f715ae48'} Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:28:12.747849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f while it is in vm_state rescued Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f while it is in vm_state rescued Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:12.749336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Returning 409 to user: Cannot 'detach_volume' instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f while it is in vm_state rescued {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:28:12.750655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c109c4c4-6366-4c82-9696-5fd6062f07e0 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments/7fbaeeb1-5ca3-48b4-8217-5b84f715ae48" status: 409 len: 152 microversion: 2.1 time: 0.097183 Jul 20 19:28:12.750655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 259/525] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:28:12 2022] DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments/7fbaeeb1-5ca3-48b4-8217-5b84f715ae48 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 19:28:12.754367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:12.754905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.761177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.761628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.762405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.762845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.830997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a2c830d8-477c-4113-84c2-1ce1661000ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/action" status: 202 len: 0 microversion: 2.1 time: 0.080145 Jul 20 19:28:12.831634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 260/526] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:28:12 2022] POST /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:28:12.840596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:12.841286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:12.849142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.849595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.850368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:12.851035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:12.855673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.863760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.865403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.866603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2599ba5f-2bb3-4cd8-be4c-667d166247b5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1406 microversion: 2.20 time: 0.164957 Jul 20 19:28:12.867254 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 267/527] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:12 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:28:12.981882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:12.989757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fdba4e04-75fd-47a3-8096-6ae34756e353 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1721 microversion: 2.1 time: 0.153772 Jul 20 19:28:12.990313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 261/528] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:12 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:13.884616 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:13.885184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:13.892175 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.892643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:13.893393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:13.893819 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.007374 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:14.007942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:14.014655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.015102 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.015871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.016318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.025295 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.033354 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.034961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.036185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e7190959-dd90-42bd-a309-c4a6b473e692 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1599 microversion: 2.20 time: 0.155626 Jul 20 19:28:14.036844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 268/529] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:28:13 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:28:14.054366 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:14.054989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:14.061739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.062258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.063125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:14.063657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:14.142060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a8123433-663c-4645-b83b-fa2a9111c9a6 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091428 Jul 20 19:28:14.142774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 269/530] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jul 20 19:28:14 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:28:14.148329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:14.156506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f1b50a36-6d33-46d2-a3ad-ca61ff29290f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1721 microversion: 2.1 time: 0.153385 Jul 20 19:28:14.157074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 262/531] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:14 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:15.049607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:15.050472 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:15.055477 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-80a93a6f-1b3e-444d-b1b2-70f58e97b4f5 req-06079abb-7b20-4692-a15b-92d1cb38b745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:15.065393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-80a93a6f-1b3e-444d-b1b2-70f58e97b4f5 req-06079abb-7b20-4692-a15b-92d1cb38b745 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.065835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-80a93a6f-1b3e-444d-b1b2-70f58e97b4f5 req-06079abb-7b20-4692-a15b-92d1cb38b745 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.077397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-80a93a6f-1b3e-444d-b1b2-70f58e97b4f5 req-06079abb-7b20-4692-a15b-92d1cb38b745 service nova] Creating event network-changed:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:28:15.082474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-80a93a6f-1b3e-444d-b1b2-70f58e97b4f5 req-06079abb-7b20-4692-a15b-92d1cb38b745 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Jul 20 19:28:15.083139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 270/532] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:15.173708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:15.174328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:15.176392 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:15.185449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.185893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.186657 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:15.187090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:15.321782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:15.330658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-23fbece3-3b6c-4936-b8ac-e1cc67086ff4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1721 microversion: 2.1 time: 0.160897 Jul 20 19:28:15.331327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 263/533] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:15 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:16.347742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:16.349050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:16.355670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.356117 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.356924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.357355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.488219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:16.496186 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e15da121-db2e-4cfa-97b3-755867d51394 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1727 microversion: 2.1 time: 0.152679 Jul 20 19:28:16.496787 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 271/534] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:16 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:16.513118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:16.513661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:16.520313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.520770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.521537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:16.521972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:16.597511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cc5155e8-c20e-4e98-85cf-5c540a95d2d1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088792 Jul 20 19:28:16.598191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 264/535] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:28:16 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:17.692702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-8019a1a2-2b10-4e2c-aa21-8d547d86c631 req-19b22920-1093-4484-bf62-6f7ae988efd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:17.702247 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-8019a1a2-2b10-4e2c-aa21-8d547d86c631 req-19b22920-1093-4484-bf62-6f7ae988efd7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:17.703298 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-8019a1a2-2b10-4e2c-aa21-8d547d86c631 req-19b22920-1093-4484-bf62-6f7ae988efd7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:17.715560 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-8019a1a2-2b10-4e2c-aa21-8d547d86c631 req-19b22920-1093-4484-bf62-6f7ae988efd7 service nova] Creating event network-changed:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:28:17.720606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-8019a1a2-2b10-4e2c-aa21-8d547d86c631 req-19b22920-1093-4484-bf62-6f7ae988efd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031802 Jul 20 19:28:17.721229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 272/536] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:19.736282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-006866b9-76f6-480f-9875-64eb2fb8431e req-489152d7-84f6-463c-8320-0f3e401adbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:19.744377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-006866b9-76f6-480f-9875-64eb2fb8431e req-489152d7-84f6-463c-8320-0f3e401adbe3 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:19.744821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-006866b9-76f6-480f-9875-64eb2fb8431e req-489152d7-84f6-463c-8320-0f3e401adbe3 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:19.758493 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-006866b9-76f6-480f-9875-64eb2fb8431e req-489152d7-84f6-463c-8320-0f3e401adbe3 service nova] Creating event network-changed:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:28:19.763285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-006866b9-76f6-480f-9875-64eb2fb8431e req-489152d7-84f6-463c-8320-0f3e401adbe3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031913 Jul 20 19:28:19.763899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 265/537] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:23.905013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:23.906013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:23.912743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.913191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.913954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:23.914388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:23.946126 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e8fad4dd-ef98-4232-a5f2-07ec517cc5a1 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046329 Jul 20 19:28:23.946692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 273/538] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:28:23 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:28:24.006683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:24.007248 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:24.013488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.013927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.014680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.015106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.042952 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:28:24.127042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-620f098b-039b-4b6c-b251-e3e5fb5d4745 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 204 len: 0 microversion: 2.1 time: 0.124835 Jul 20 19:28:24.127855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 266/539] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:28:24 2022] DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:28:24.135742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:24.136375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:24.142906 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.143378 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.144202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:24.144693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:24.149008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:24.283251 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:24.291003 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9b2cf164-3d24-48dd-9ac2-3a4af8d7b7ac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1673 microversion: 2.1 time: 0.159189 Jul 20 19:28:24.291573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 274/540] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:24 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:25.309768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:25.310463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:25.316985 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.317437 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.318201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:25.318637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:25.461158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:25.468685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c4ec5e8f-0aee-46b2-af9d-b739e3229b7e tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1673 microversion: 2.1 time: 0.163537 Jul 20 19:28:25.469329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 267/541] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:25 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:26.487190 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.488139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.497905 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.498445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.499347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.499986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.717579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.718154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.725275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.726197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.726512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.726947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.755291 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:28:26.781051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:26.838919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7e25171b-fa4d-4258-b830-30dc947bcbc4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 204 len: 0 microversion: 2.1 time: 0.124888 Jul 20 19:28:26.839527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 268/542] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:28:26 2022] DELETE /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:28:26.848951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:26.849638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:26.856820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.857368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.858160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:26.858621 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:26.991404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:26.998752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:27.000673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e2a48bb4-5dba-4ec2-bb3f-4639982831f8 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1673 microversion: 2.1 time: 0.518373 Jul 20 19:28:27.008355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 275/543] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1673 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:27.008560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dd6f6a4d-3682-4332-9038-573b0181e06c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1580 microversion: 2.1 time: 0.163154 Jul 20 19:28:27.008560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 269/544] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:26 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:27.412788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-5157f028-44ce-4939-875a-181e87e676ce req-486d0a8d-486a-46ea-9102-f61cf4449ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f977b5-705c-46e5-b597-311c97d2edea", "name": "network-vif-deleted", "tag": "a8824afd-c0c0-48f6-a2ee-5085bf6628cf"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:27.422104 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-5157f028-44ce-4939-875a-181e87e676ce req-486d0a8d-486a-46ea-9102-f61cf4449ae0 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:27.422559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-5157f028-44ce-4939-875a-181e87e676ce req-486d0a8d-486a-46ea-9102-f61cf4449ae0 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:27.433370 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-5157f028-44ce-4939-875a-181e87e676ce req-486d0a8d-486a-46ea-9102-f61cf4449ae0 service nova] Creating event network-vif-deleted:a8824afd-c0c0-48f6-a2ee-5085bf6628cf for instance 58f977b5-705c-46e5-b597-311c97d2edea on hv-cinder-81914 Jul 20 19:28:27.438397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-5157f028-44ce-4939-875a-181e87e676ce req-486d0a8d-486a-46ea-9102-f61cf4449ae0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029337 Jul 20 19:28:27.439244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 276/545] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:28.019331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:28.020590 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:28.025262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:28.025956 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:28.027268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.027924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.028882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.029315 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.034435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.034435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.034435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.034874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.123238 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.133068 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9c61aedb-70ee-414e-b668-0eb45151d7d3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 200 len: 1605 microversion: 2.1 time: 0.117821 Jul 20 19:28:28.137018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 270/546] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:28 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 1605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:28.213233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:28.222050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1f8bba70-1232-40ed-9abb-c82b8b10facb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1580 microversion: 2.1 time: 0.200870 Jul 20 19:28:28.222647 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 277/547] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:28 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1580 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:28.698318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-03808068-54fb-4c4f-897b-92a947d8b997 req-f69e605d-3fa0-47cf-b171-6557a23499b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d469a829-8282-4106-a0d6-4197710acf5f", "name": "network-vif-unplugged", "status": "completed", "tag": "3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:28.701962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:28.707721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-03808068-54fb-4c4f-897b-92a947d8b997 req-f69e605d-3fa0-47cf-b171-6557a23499b2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:28.708204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-03808068-54fb-4c4f-897b-92a947d8b997 req-f69e605d-3fa0-47cf-b171-6557a23499b2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:28.724467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-03808068-54fb-4c4f-897b-92a947d8b997 req-f69e605d-3fa0-47cf-b171-6557a23499b2 service nova] Creating event network-vif-unplugged:3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2 for instance d469a829-8282-4106-a0d6-4197710acf5f on hv-cinder-81914 Jul 20 19:28:28.730384 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-03808068-54fb-4c4f-897b-92a947d8b997 req-f69e605d-3fa0-47cf-b171-6557a23499b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035168 Jul 20 19:28:28.731000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 271/548] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:28:29.154319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.154907 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.161552 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.162025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.162783 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.163221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.177086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea HTTP/1.1 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:28:29.178739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:28:29.180371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '58f977b5-705c-46e5-b597-311c97d2edea'} Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:28:29.181259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:28:29.182482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:28:29.183657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:28:29.183657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ba36ea45-7373-4a12-a111-e5b2108737af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 404 len: 111 microversion: 2.1 time: 0.030342 Jul 20 19:28:29.183657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 278/549] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:29.190898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3d81629a-23c9-4cb1-9725-8229f6d60f16 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '.version_select at 0x7f26c3dd8820>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.212748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3d81629a-23c9-4cb1-9725-8229f6d60f16 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317657895" status: 202 len: 0 microversion: 2.1 time: 0.026892 Jul 20 19:28:29.213399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 272/550] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 19:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317657895 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:28:29.239145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:29.239972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:29.246191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.246831 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.247559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.248072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.478733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:29.495721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b1732937-d84b-42ba-864c-9dbf6b2b9077 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1580 microversion: 2.1 time: 0.259962 Jul 20 19:28:29.506851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 279/551] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:29 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1580 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:29.758384 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-3cd92cfc-4e18-4a1f-952b-5a76180e2453 req-bcb5dabf-35f7-467e-a401-607897c290cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d469a829-8282-4106-a0d6-4197710acf5f", "name": "network-vif-deleted", "tag": "3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:29.770456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-3cd92cfc-4e18-4a1f-952b-5a76180e2453 req-bcb5dabf-35f7-467e-a401-607897c290cc service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:29.770957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-3cd92cfc-4e18-4a1f-952b-5a76180e2453 req-bcb5dabf-35f7-467e-a401-607897c290cc service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:29.783275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-3cd92cfc-4e18-4a1f-952b-5a76180e2453 req-bcb5dabf-35f7-467e-a401-607897c290cc service nova] Creating event network-vif-deleted:3c0e670b-adf0-45a3-a7fd-949ac5c1fbd2 for instance d469a829-8282-4106-a0d6-4197710acf5f on hv-cinder-81914 Jul 20 19:28:29.789650 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-3cd92cfc-4e18-4a1f-952b-5a76180e2453 req-bcb5dabf-35f7-467e-a401-607897c290cc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035359 Jul 20 19:28:29.790734 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 273/552] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:29.910794 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6485d831-6de4-4799-8ed0-4ac590a4b281 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: .version_select at 0x7f26c1a6a430>, body: {"keypair": {"name": "tempest-keypair-2095627375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyguJYaxux4vB7fjyu8Wsx11+9OzHCmSBCNq7EfPs9VGyqvfFZg6dB3gLNlJXPrW1HacsYKeNiWrYwcQm/nQJdzUlDOkBJnwayw0MEw9Lwq5NhJZAo/A0JTopFzWScIkA=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:29.927103 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-6485d831-6de4-4799-8ed0-4ac590a4b281 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for project 654a322fff99416595c66a993aeaee17. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:29.931206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-6485d831-6de4-4799-8ed0-4ac590a4b281 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for user b15f8d66d5104aaeae51e6c1fa3b3596 and project 654a322fff99416595c66a993aeaee17. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:29.959176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6485d831-6de4-4799-8ed0-4ac590a4b281 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052425 Jul 20 19:28:29.959912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 280/553] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:28:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:30.515133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:30.516177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:30.528978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.530031 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.531781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.532454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.582535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:30.582978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:30.583599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lazy-loading 'fault' on Instance uuid d469a829-8282-4106-a0d6-4197710acf5f {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:28:30.637272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:30.644727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3ca0a9f3-d621-4b48-a45a-ded7347df7ea tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 200 len: 1185 microversion: 2.1 time: 0.134786 Jul 20 19:28:30.645586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 274/554] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:30 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:31.320237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1738556156", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5bb1c67-48ca-4e2c-b322-fdd0133524e4"}], "security_groups": [{"name": "tempest-securitygroup--890095723"}], "key_name": "tempest-keypair-2095627375", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:31.419809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] validate_networks() for [('f5bb1c67-48ca-4e2c-b322-fdd0133524e4', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:31.662760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.663520 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.670671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.671040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.671808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.672243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.686273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] HTTP exception thrown: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Request method failure captured: Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f HTTP/1.1 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FaPCzCXhCDK1_HmAuSuXMqDalt2BiGEihr9CJS15YHUk9MXLyI5FChMo7oi-ILdk_sWZP2A74imqUA67y1RZKBOx4t5AFBfIiC7gLLpk_lMhspkor7qAQ7elwItpniLljdURUoJvWid3aS7kjdlZJw_clQ9HBMaxcLODo2r9AJJBRE Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:28:31.687946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_182d5b6ac9e6412b907119a623869c80", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}] Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 4a4f4d585adf40b880be44c29ecd53cd Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:28:31.690119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'd469a829-8282-4106-a0d6-4197710acf5f'} Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:28:31.690998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:28:31.692194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:28:31.693865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Returning 404 to user: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:28:31.693865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-166fb39a-4372-4387-bb0a-329cf2a44d1c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 404 len: 111 microversion: 2.1 time: 0.030879 Jul 20 19:28:31.693865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 275/555] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:28:31.786650 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1914415570", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1218028535", "security_groups": [{"name": "tempest-secgroup-smoke-1429967910"}], "block_device_mapping_v2": [{"uuid": "9d30f604-6a7b-4c1a-9d8d-124718df0b21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "667371d0-bd3e-4fe0-a41c-e04f1b0a0f03"}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:31.814542 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:31.814962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:31.815428 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:31.815832 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:31.816264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:31.825557 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.826010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.826823 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:31.827434 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:31.844309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for project 654a322fff99416595c66a993aeaee17. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:31.848518 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Getting quotas for user b15f8d66d5104aaeae51e6c1fa3b3596 and project 654a322fff99416595c66a993aeaee17. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:31.860560 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:31.862889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:31.910466 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-59c6ea3d-abaf-42de-abfc-97b9c9e2fe69 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594898 Jul 20 19:28:31.911557 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 281/556] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:28:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:28:31.920631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] validate_networks() for [('667371d0-bd3e-4fe0-a41c-e04f1b0a0f03', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:28:31.923281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ebae32f0-7103-4cd6-9845-04733c33bf39 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:31.923868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ebae32f0-7103-4cd6-9845-04733c33bf39 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:31.986452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ebae32f0-7103-4cd6-9845-04733c33bf39 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:31.993654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ebae32f0-7103-4cd6-9845-04733c33bf39 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1238 microversion: 2.1 time: 0.075184 Jul 20 19:28:31.994097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 282/557] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:31 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:32.352023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:28:32.352466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:28:32.353224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:28:32.353323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:28:32.353729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:28:32.362709 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.363151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.363962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:32.364419 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:32.382780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:28:32.387681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for user 4a4f4d585adf40b880be44c29ecd53cd and project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:28:32.448159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:28:32.451025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d30f604-6a7b-4c1a-9d8d-124718df0b21',volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:28:32.581403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c74f8d22-f7fa-4254-967c-00bf935aa6db tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798087 Jul 20 19:28:32.582334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 276/558] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:28:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:28:32.591986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b9f311b6-6991-4e6b-95cf-fd0c4bd99c6b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:32.592616 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b9f311b6-6991-4e6b-95cf-fd0c4bd99c6b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:32.594959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:32.652860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b9f311b6-6991-4e6b-95cf-fd0c4bd99c6b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:32.659461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b9f311b6-6991-4e6b-95cf-fd0c4bd99c6b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1095 microversion: 2.1 time: 0.071347 Jul 20 19:28:32.660026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 283/559] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:32 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:33.012264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.012916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.020179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.021018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.021880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.022504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.090383 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.098564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-80d35b29-11ee-4b68-b908-bc912d68b619 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1296 microversion: 2.1 time: 0.092574 Jul 20 19:28:33.099133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 277/560] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:33.678248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:33.679569 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:33.691601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.692314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.693367 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:33.694035 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:33.791620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:33.805258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-28e07139-e98c-4446-8ca2-08f88546e817 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1211 microversion: 2.1 time: 0.131932 Jul 20 19:28:33.806369 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 284/561] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:33 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1211 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:34.115101 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:34.115708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:34.131836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.132279 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.133345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.133950 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.412659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:34.427039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-577672f5-a329-4c7a-a94d-5aa7819fa7ba tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.315410 Jul 20 19:28:34.428684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 278/562] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:34 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:28:34.559954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-ceef77ab-d30b-4857-8c64-cab4ab437ee2 req-222446fd-c040-4d9e-844f-af49d68ac286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfc06e5-b70e-443b-9192-6a0af96a58db", "tag": "e1e7bed1-e7ec-4008-a6b1-b81f384e1cea"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:34.576736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-ceef77ab-d30b-4857-8c64-cab4ab437ee2 req-222446fd-c040-4d9e-844f-af49d68ac286 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.577736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-ceef77ab-d30b-4857-8c64-cab4ab437ee2 req-222446fd-c040-4d9e-844f-af49d68ac286 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.609279 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-ceef77ab-d30b-4857-8c64-cab4ab437ee2 req-222446fd-c040-4d9e-844f-af49d68ac286 service nova] Creating event network-changed:e1e7bed1-e7ec-4008-a6b1-b81f384e1cea for instance 2bfc06e5-b70e-443b-9192-6a0af96a58db on hv-cinder-81914 Jul 20 19:28:34.620620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-ceef77ab-d30b-4857-8c64-cab4ab437ee2 req-222446fd-c040-4d9e-844f-af49d68ac286 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066184 Jul 20 19:28:34.622871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 285/563] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:34.826208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:34.826819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:34.849011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.850536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:34.851361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:34.851810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.068841 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.082835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-80c5e325-ef00-46b7-8911-abdd554a5eeb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.260981 Jul 20 19:28:35.083530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 279/564] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:34 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:35.377636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-db8fb928-a28c-4f47-9645-be09d84dd04f req-ddd3d15d-41c1-405c-b7ee-a2e5b080bfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0908d1-fce4-4940-abd9-c6ea2ca59582", "tag": "d4258cc8-3ff2-4715-a57c-63a1ef623811"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:35.386402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-db8fb928-a28c-4f47-9645-be09d84dd04f req-ddd3d15d-41c1-405c-b7ee-a2e5b080bfee service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.386994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-db8fb928-a28c-4f47-9645-be09d84dd04f req-ddd3d15d-41c1-405c-b7ee-a2e5b080bfee service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.398686 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-db8fb928-a28c-4f47-9645-be09d84dd04f req-ddd3d15d-41c1-405c-b7ee-a2e5b080bfee service nova] Creating event network-changed:d4258cc8-3ff2-4715-a57c-63a1ef623811 for instance da0908d1-fce4-4940-abd9-c6ea2ca59582 on hv-cinder-81914 Jul 20 19:28:35.404950 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-db8fb928-a28c-4f47-9645-be09d84dd04f req-ddd3d15d-41c1-405c-b7ee-a2e5b080bfee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031835 Jul 20 19:28:35.405897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 286/565] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:35.446931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:35.447531 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:35.454264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.454711 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.455559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:35.455928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:35.590686 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:35.598723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ebe0128d-56e9-4006-9fdf-6f3917683553 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.155700 Jul 20 19:28:35.599378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 280/566] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:35 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:36.102688 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:36.103632 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:36.110839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.111415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.112394 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.113008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.332350 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.344394 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-98bd2ac6-9c53-4ae6-bf73-06920105fc72 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.247580 Jul 20 19:28:36.345104 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 287/567] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:36 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:36.617015 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:36.618368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:36.625922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.626611 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.627705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:36.628402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:36.782922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:36.790995 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fa1822b3-773f-4052-8e08-85cbb2fb1aa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.178485 Jul 20 19:28:36.801142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 281/568] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:36 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:37.361399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.362028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.368891 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.369338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.370099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.370530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.498888 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:37.506663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dd65446f-190e-49da-b140-cd2ac373aebf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.149118 Jul 20 19:28:37.507234 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 288/569] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:37.809061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:37.809845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:37.816560 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.817029 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:37.817786 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:37.818219 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.195664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.203119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d2260203-7a23-4f89-bcab-7dc10cae24a3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.398759 Jul 20 19:28:38.203689 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 282/570] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:37 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:38.524162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:38.524849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:38.531751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.532195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.533153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.533587 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.668603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:38.675640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8dba63d3-ca3e-401c-b0c0-e72e72d844fc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.155357 Jul 20 19:28:38.676221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 289/571] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:38 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:38.769889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-022f8bb2-a721-407f-a74b-32b4da0c9b84 req-6056c372-e279-43f9-8e50-727c61bfea5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfc06e5-b70e-443b-9192-6a0af96a58db", "name": "network-vif-plugged", "status": "completed", "tag": "e1e7bed1-e7ec-4008-a6b1-b81f384e1cea"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:38.779760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-022f8bb2-a721-407f-a74b-32b4da0c9b84 req-6056c372-e279-43f9-8e50-727c61bfea5c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:38.780316 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-022f8bb2-a721-407f-a74b-32b4da0c9b84 req-6056c372-e279-43f9-8e50-727c61bfea5c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:38.791435 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-022f8bb2-a721-407f-a74b-32b4da0c9b84 req-6056c372-e279-43f9-8e50-727c61bfea5c service nova] Creating event network-vif-plugged:e1e7bed1-e7ec-4008-a6b1-b81f384e1cea for instance 2bfc06e5-b70e-443b-9192-6a0af96a58db on hv-cinder-81914 Jul 20 19:28:38.796175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-022f8bb2-a721-407f-a74b-32b4da0c9b84 req-6056c372-e279-43f9-8e50-727c61bfea5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 Jul 20 19:28:38.796789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 283/572] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:39.230737 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:39.231345 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:39.237537 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.237987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.238749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.239181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.369153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.377057 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-eee0149c-2ff7-4854-9c1b-7a6752fad653 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.154170 Jul 20 19:28:39.377617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 290/573] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:39 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:39.693818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:39.694507 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:39.700916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.701377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.702132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:39.702568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:39.830728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:39.838105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a6c3f114-3b53-4469-bcdd-f77a15f74de2 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.149194 Jul 20 19:28:39.839169 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 284/574] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:39 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:40.394533 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.395143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.402324 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.402778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.403549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.403986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.530519 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:40.538486 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f5692209-7aa5-4625-81ad-4ea2cdbed432 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1363 microversion: 2.1 time: 0.147853 Jul 20 19:28:40.539057 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 291/575] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:40.855144 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:40.855812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:40.862433 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.862956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.863640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:40.864077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:40.997646 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.005126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-03e244df-ace5-44ab-bba2-d9ce55ad0ac1 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.153834 Jul 20 19:28:41.005691 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 285/576] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:40 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:41.555289 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:41.555825 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:41.562761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.563207 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.564341 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.564775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.689910 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:41.697868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d553ac69-a6e1-41f1-802b-a0f4aed21aac tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1550 microversion: 2.1 time: 0.146540 Jul 20 19:28:41.698470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 292/577] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:41 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1550 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:41.713933 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:41.714422 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:41.720436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.720883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.721638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:41.722073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:41.798212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-81588811-51e5-4e34-8009-89ff2cb021a6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088114 Jul 20 19:28:41.798823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 286/578] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:28:41 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:42.022467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:42.022993 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:42.024960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:42.030478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.030933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.031706 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.032146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.166083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:42.174236 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d5f585b7-61a4-4e9f-8962-4e4c82f06a1d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.155617 Jul 20 19:28:42.174818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 293/579] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:42 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:42.725232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:42.726134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:42.730363 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-3cad5f3f-3075-4419-be11-7f5ae102e101 req-15d235c9-5cd3-4172-aae4-ad7b604a3fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfc06e5-b70e-443b-9192-6a0af96a58db", "tag": "e1e7bed1-e7ec-4008-a6b1-b81f384e1cea"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:42.739722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-3cad5f3f-3075-4419-be11-7f5ae102e101 req-15d235c9-5cd3-4172-aae4-ad7b604a3fd7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:42.740253 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-3cad5f3f-3075-4419-be11-7f5ae102e101 req-15d235c9-5cd3-4172-aae4-ad7b604a3fd7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:42.751326 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-3cad5f3f-3075-4419-be11-7f5ae102e101 req-15d235c9-5cd3-4172-aae4-ad7b604a3fd7 service nova] Creating event network-changed:e1e7bed1-e7ec-4008-a6b1-b81f384e1cea for instance 2bfc06e5-b70e-443b-9192-6a0af96a58db on hv-cinder-81914 Jul 20 19:28:42.756404 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-3cad5f3f-3075-4419-be11-7f5ae102e101 req-15d235c9-5cd3-4172-aae4-ad7b604a3fd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Jul 20 19:28:42.757018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 287/580] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:43.191287 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:43.192186 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:43.194761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=14 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:43.200903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.201743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.203307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:43.203857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:43.657872 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:43.665402 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-197201c2-c74d-49aa-8f65-f0515b52ba07 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.478260 Jul 20 19:28:43.666318 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 294/581] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:43 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:44.684209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:44.685030 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:44.692828 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.693273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.694131 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:44.694627 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:44.829854 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:44.837434 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6d121231-369e-4908-a893-4b777c0d4d63 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.158139 Jul 20 19:28:44.838020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 288/582] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:44 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:45.855152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:45.855748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:45.862281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.862758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.863512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:45.863942 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:45.998876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:46.006453 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b74729fb-3e26-417b-8d88-825fad90e41d tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.155450 Jul 20 19:28:46.007018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 295/583] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:45 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:46.808080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-938fdcfc-f77b-4b18-9e04-b555a75915c6 req-71469d0f-a767-412e-86d8-f832ee6cc541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0908d1-fce4-4940-abd9-c6ea2ca59582", "name": "network-vif-plugged", "status": "completed", "tag": "d4258cc8-3ff2-4715-a57c-63a1ef623811"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:46.818046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-938fdcfc-f77b-4b18-9e04-b555a75915c6 req-71469d0f-a767-412e-86d8-f832ee6cc541 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:46.818496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-938fdcfc-f77b-4b18-9e04-b555a75915c6 req-71469d0f-a767-412e-86d8-f832ee6cc541 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:46.830324 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-938fdcfc-f77b-4b18-9e04-b555a75915c6 req-71469d0f-a767-412e-86d8-f832ee6cc541 service nova] Creating event network-vif-plugged:d4258cc8-3ff2-4715-a57c-63a1ef623811 for instance da0908d1-fce4-4940-abd9-c6ea2ca59582 on hv-cinder-81914 Jul 20 19:28:46.835095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-938fdcfc-f77b-4b18-9e04-b555a75915c6 req-71469d0f-a767-412e-86d8-f832ee6cc541 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Jul 20 19:28:46.835697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 289/584] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:47.023573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:47.024683 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:47.031912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.033099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.033876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:47.034307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:47.220885 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:47.228403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-06a528c4-ed17-4984-924b-519367452bbf tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.208765 Jul 20 19:28:47.228976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 296/585] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:47 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:48.246231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:48.246953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:48.253305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.253748 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.254538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:48.254974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:48.257718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:48.403927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:48.411391 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1113a504-7be8-429c-87c5-7fa6b8279dbb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1267 microversion: 2.1 time: 0.169863 Jul 20 19:28:48.411970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 290/586] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:48 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:49.429304 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:49.429814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:49.436991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.437456 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.438233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.438674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.442943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:49.571128 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.578672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-98981fc2-1ad4-4f91-a326-24844d62cb8c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1455 microversion: 2.1 time: 0.153322 Jul 20 19:28:49.579243 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 297/587] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:49 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:49.595449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:49.596052 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:49.602630 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.603017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.603813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:49.604869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:49.734871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:49.742648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6589472c-eb6f-4939-afb4-971b05895591 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1455 microversion: 2.1 time: 0.150984 Jul 20 19:28:49.743224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 291/588] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:49 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:51.361676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-4af8c5fd-7ac3-4a05-a846-4bfe25bd04ba req-f8ade1f5-b44b-4f61-854d-b09cbabc89b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0908d1-fce4-4940-abd9-c6ea2ca59582", "tag": "d4258cc8-3ff2-4715-a57c-63a1ef623811"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:28:51.370829 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-4af8c5fd-7ac3-4a05-a846-4bfe25bd04ba req-f8ade1f5-b44b-4f61-854d-b09cbabc89b8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:51.371274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-4af8c5fd-7ac3-4a05-a846-4bfe25bd04ba req-f8ade1f5-b44b-4f61-854d-b09cbabc89b8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:51.382646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-4af8c5fd-7ac3-4a05-a846-4bfe25bd04ba req-f8ade1f5-b44b-4f61-854d-b09cbabc89b8 service nova] Creating event network-changed:d4258cc8-3ff2-4715-a57c-63a1ef623811 for instance da0908d1-fce4-4940-abd9-c6ea2ca59582 on hv-cinder-81914 Jul 20 19:28:51.387916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-4af8c5fd-7ac3-4a05-a846-4bfe25bd04ba req-f8ade1f5-b44b-4f61-854d-b09cbabc89b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030106 Jul 20 19:28:51.388548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 298/589] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:56.572399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:56.572997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:56.579638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.580087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.580887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.581325 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.778973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'services' on Instance uuid 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:28:56.853983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9bc1dc90-a580-4032-8eb9-267de27b6baa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments/7fbaeeb1-5ca3-48b4-8217-5b84f715ae48" status: 202 len: 0 microversion: 2.1 time: 0.285574 Jul 20 19:28:56.855535 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 292/590] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:28:56 2022] DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments/7fbaeeb1-5ca3-48b4-8217-5b84f715ae48 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:28:56.865804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:56.866725 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:56.873775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.874223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.875001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:56.875435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:56.906469 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-29ce4c77-5282-4ca9-9d73-efe742ddd63d tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046091 Jul 20 19:28:56.907036 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 299/591] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:28:56 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:28:57.918179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:57.919275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:57.926053 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.926503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.927298 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:57.927737 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:57.957381 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-003c6092-575c-43a6-bcbd-4f9f4f2ef4a3 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043474 Jul 20 19:28:57.957946 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 293/592] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:28:57 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:28:58.031231 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:58.032327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:58.038694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.039162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.039968 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.040506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.067724 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:28:58.146629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e0c0e53d-a4c6-473e-958b-9aca9465f703 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 204 len: 0 microversion: 2.1 time: 0.119940 Jul 20 19:28:58.147267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 300/593] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:28:58 2022] DELETE /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:28:58.156747 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:58.157412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:58.163608 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.164061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.164886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.165317 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.296733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:58.304225 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bbbdd8f5-eabf-4393-bf48-a1ce878f269c tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1687 microversion: 2.1 time: 0.152632 Jul 20 19:28:58.304821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 294/594] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:58 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:28:58.420620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:58.421229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:58.427246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.427702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.428505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:58.428941 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:58.456639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1fb717b2-590f-4741-9583-c67beecfb58c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/ips" status: 200 len: 152 microversion: 2.20 time: 0.040796 Jul 20 19:28:58.457234 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 301/595] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jul 20 19:28:58 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 19:28:59.321997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:28:59.322599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:28:59.325606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:59.330931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.331368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.332120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:28:59.332571 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:28:59.473547 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:28:59.481013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1e6ccda5-6aaa-48fa-a12b-5547150f877b tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1687 microversion: 2.1 time: 0.162833 Jul 20 19:28:59.481579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 295/596] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:28:59 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:00.499591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.500220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.507172 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.507619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.508425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.508866 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.629975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:00.630580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.637647 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.638099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.638869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.639303 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.665076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lazy-loading 'flavor' on Instance uuid 69446528-3449-410e-9271-ffb9da39557c {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:00.759051 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:00.767844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c4d65d55-c509-4e35-9703-16f206c297f4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1687 microversion: 2.1 time: 0.272580 Jul 20 19:29:00.768444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 302/597] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1687 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:00.943987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d948cff0-ba85-4f18-aaba-2948d128382b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/action" status: 202 len: 0 microversion: 2.20 time: 0.317685 Jul 20 19:29:00.944661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 296/598] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 19:29:00 2022] POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:29:00.954261 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:00.954931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:00.961145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.961631 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:00.962397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:00.962830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.101995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.110724 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.112866 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.114113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7f45e08c-58b3-4f8c-9511-d57103750634 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.163836 Jul 20 19:29:01.115002 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 303/599] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:00 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:01.786835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:01.787491 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:01.794338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.794778 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.795526 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:01.795952 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:01.937259 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:01.945626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e738f3d4-f174-4ac2-a7a8-fe2656389bb7 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1687 microversion: 2.1 time: 0.163506 Jul 20 19:29:01.946236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 297/600] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:01 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:02.133818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.134451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.141816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.142262 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.143031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.143461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.284524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.292624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.294702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:02.295912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-49417bfd-de13-4357-a586-949da8fa7186 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.166007 Jul 20 19:29:02.296512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 304/601] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:02.963044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:02.963810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:02.970852 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.971310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:02.972408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:02.972594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.105961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.114447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e1c6efae-47a9-4ded-9880-f8ba51754c72 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1687 microversion: 2.1 time: 0.155367 Jul 20 19:29:03.115030 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 298/602] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:02 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:03.314110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:03.315009 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:03.318003 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:03.322961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.323661 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.324645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.325248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.578182 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-338ce932-d5c7-40dc-b4ec-df1502cca534 req-d71b33c6-2209-40f5-8416-e2ceee1d8517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f", "name": "network-vif-deleted", "tag": "2f2d1c4b-7fdb-4f76-98ba-0efb7034305f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:03.579353 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.594528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.594788 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-338ce932-d5c7-40dc-b4ec-df1502cca534 req-d71b33c6-2209-40f5-8416-e2ceee1d8517 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:03.595211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-338ce932-d5c7-40dc-b4ec-df1502cca534 req-d71b33c6-2209-40f5-8416-e2ceee1d8517 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:03.597666 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:03.599187 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9b0c9700-ddd2-40aa-9ae6-7c9b9d0fe6aa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.289055 Jul 20 19:29:03.600351 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 305/603] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:03 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:03.625927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-338ce932-d5c7-40dc-b4ec-df1502cca534 req-d71b33c6-2209-40f5-8416-e2ceee1d8517 service nova] Creating event network-vif-deleted:2f2d1c4b-7fdb-4f76-98ba-0efb7034305f for instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f on hv-cinder-81914 Jul 20 19:29:03.634695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-338ce932-d5c7-40dc-b4ec-df1502cca534 req-d71b33c6-2209-40f5-8416-e2ceee1d8517 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061067 Jul 20 19:29:03.635302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 299/604] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:04.131519 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:04.132163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:04.139089 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.139555 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.140361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.140815 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.172912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.173693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.174155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'fault' on Instance uuid 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:04.222495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.230185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d9dae11c-35be-4dbd-924a-2d9711892b98 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 200 len: 1335 microversion: 2.1 time: 0.101944 Jul 20 19:29:04.230801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 306/605] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:04 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:04.676424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:04.677131 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:04.683631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.684072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.684873 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:04.685300 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:04.833351 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.842363 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.843871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:04.845122 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-66545c28-19fa-4d55-8617-1e613ef4d9ca tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.230090 Jul 20 19:29:04.845838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 300/606] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:04 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:05.247044 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.247587 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.254481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.254929 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.255685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.256120 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.272134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] HTTP exception thrown: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Request method failure captured: Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f HTTP/1.1 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZIvF9ugpYe7-0EakHvix28xoFUPQn3x00w9KlsVzx0MTq9fViqd6xYxIRuVykPcSdM1tmeO8WbrYvngtZjMNZUDCwo9vCvRY7cqq20wFulaUk9Q9wgJPdKIVPxV2mqDDKlGy4LzA80A3dKZgYxMkIipqBj12PxR2ekvxmnIcoYR20 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:29:05.273817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0f63357734c4efa9a88c07996aa5551", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}] Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: cb06eeba738b452fab3986de7e1f7856 Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. Jul 20 19:29:05.275392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f'} Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:05.276889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. Jul 20 19:29:05.278452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:05.279717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Returning 404 to user: Instance 0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:05.279717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8154a6ba-7cc4-4c0c-9394-261975a809ba tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f" status: 404 len: 111 microversion: 2.1 time: 0.032112 Jul 20 19:29:05.279717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 307/607] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/0dc34d8d-6e4e-4bdd-b1fb-f5dc5c46993f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:29:05.284427 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ad5a882e-39af-4a5d-b3e5-4c807f1c8ff8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '.version_select at 0x7f26c14b0550>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.301603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ad5a882e-39af-4a5d-b3e5-4c807f1c8ff8 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-145603414" status: 202 len: 0 microversion: 2.1 time: 0.020853 Jul 20 19:29:05.302168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 301/608] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 19:29:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-145603414 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:29:05.864042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:05.864709 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:05.871506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.871958 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:05.872916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:05.873198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:06.016436 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.024580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.026092 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:06.027740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d4dbf944-b699-4e3d-8226-dea70a27c2b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.167724 Jul 20 19:29:06.028321 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 308/609] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:05 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:07.046808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:07.047497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:07.053762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.054492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.055276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:07.055701 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:07.451085 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.458829 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.460361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:07.461511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5285b5df-181f-48aa-a059-ecd53565d7b9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.419383 Jul 20 19:29:07.462072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 302/610] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:07 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:08.173055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:08.173667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:08.179983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.180468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.181242 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.181681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.207139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:29:08.291030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a043a439-fa7a-48e8-89c7-8d8de8b886ed tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 204 len: 0 microversion: 2.1 time: 0.121853 Jul 20 19:29:08.293135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 309/611] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:29:08 2022] DELETE /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:29:08.304635 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:08.305223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:08.311949 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.312420 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.313190 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.313627 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.447529 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.455124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-746489a7-555d-4099-b350-9a502803bde5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1508 microversion: 2.1 time: 0.154620 Jul 20 19:29:08.455705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 303/612] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:08 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:08.480077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:08.480801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:08.487159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.487611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.488420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:08.488897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:08.632246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.640648 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.642172 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:08.643334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5f013d4d-ff76-4fe4-93a5-f10902c5a0b2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.168205 Jul 20 19:29:08.643896 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 310/613] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:08 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:09.472760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:09.473362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:09.480804 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.481244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.482006 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.482435 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.613791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.622853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ed32b6c7-25b8-46c3-ae11-2013b76b49d4 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1508 microversion: 2.1 time: 0.153847 Jul 20 19:29:09.623430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 304/614] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:09 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:09.662000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:09.662602 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:09.669722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.670203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.670976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:09.671411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:09.805849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.809412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:09.815220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.816773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:09.817952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-978a38e8-95cf-4bd8-a80d-361bc150c774 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.159902 Jul 20 19:29:09.818518 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 311/615] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:09 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:10.640569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.641095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.648198 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.648663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.649430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.649860 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.780476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:10.782834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:10.789749 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fcc8cd39-2e41-4f6f-b9e3-54b69c171ed9 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1508 microversion: 2.1 time: 0.153845 Jul 20 19:29:10.790345 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 305/616] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:10.836377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:10.837041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:10.845478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.845934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:10.846717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:10.847154 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.015564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.023885 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.025425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.026646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d9418972-d653-4b94-bb8e-073bb64fee13 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.194310 Jul 20 19:29:11.027203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 312/617] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:10 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:11.447812 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-7ee9c3e0-d20c-4668-9c01-5db68589d7a9 req-c6e2f2ec-3470-4008-8b8e-af2cf4e2d069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2a941f-55c0-4b7d-a7fb-441d99569c0a", "name": "network-vif-deleted", "tag": "12c14f37-54d6-465f-98a8-80c125855fe5"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:11.457047 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-7ee9c3e0-d20c-4668-9c01-5db68589d7a9 req-c6e2f2ec-3470-4008-8b8e-af2cf4e2d069 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.457845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-7ee9c3e0-d20c-4668-9c01-5db68589d7a9 req-c6e2f2ec-3470-4008-8b8e-af2cf4e2d069 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.471858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-7ee9c3e0-d20c-4668-9c01-5db68589d7a9 req-c6e2f2ec-3470-4008-8b8e-af2cf4e2d069 service nova] Creating event network-vif-deleted:12c14f37-54d6-465f-98a8-80c125855fe5 for instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a on hv-cinder-81914 Jul 20 19:29:11.488995 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-7ee9c3e0-d20c-4668-9c01-5db68589d7a9 req-c6e2f2ec-3470-4008-8b8e-af2cf4e2d069 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046113 Jul 20 19:29:11.489619 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 306/618] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:11.806698 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:11.807308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:11.814189 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.814890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.815671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.816149 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.852676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:11.853670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:11.853670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'fault' on Instance uuid 1a2a941f-55c0-4b7d-a7fb-441d99569c0a {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:11.895933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:11.904674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ad0b27d0-d67b-41d7-946c-692a2ce78a7a tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 200 len: 1312 microversion: 2.1 time: 0.102024 Jul 20 19:29:11.905275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 313/619] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:11 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:12.048278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:12.048997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:12.055781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.056258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.057172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.058132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.196400 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.205440 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.206935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:12.208111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cc4c7109-2f3a-40c0-bdf1-a6895497cca0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.165817 Jul 20 19:29:12.208707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 307/620] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:12 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:12.922072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:12.922674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 1a2a941f-55c0-4b7d-a7fb-441d99569c0a] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:12.929131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.929577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.930330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.930761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.944182 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] HTTP exception thrown: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Request method failure captured: Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a HTTP/1.1 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZIvF9ugpYe7-0EakHvix28xoFUPQn3x00w9KlsVzx0MTq9fViqd6xYxIRuVykPcSdM1tmeO8WbrYvngtZjMNZUDCwo9vCvRY7cqq20wFulaUk9Q9wgJPdKIVPxV2mqDDKlGy4LzA80A3dKZgYxMkIipqBj12PxR2ekvxmnIcoYR20 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:29:12.945843 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0f63357734c4efa9a88c07996aa5551", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}] Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: cb06eeba738b452fab3986de7e1f7856 Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. Jul 20 19:29:12.947344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '1a2a941f-55c0-4b7d-a7fb-441d99569c0a'} Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:12.948406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. Jul 20 19:29:12.949935 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:12.951384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Returning 404 to user: Instance 1a2a941f-55c0-4b7d-a7fb-441d99569c0a could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:12.951384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3b0dc909-11ce-4652-8bbc-03e068545bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a" status: 404 len: 111 microversion: 2.1 time: 0.029063 Jul 20 19:29:12.951384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 314/621] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:12 2022] GET /compute/v2.1/servers/1a2a941f-55c0-4b7d-a7fb-441d99569c0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:12.955895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:12.956418 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:12.962497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.962900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.964151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:12.964610 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:12.989043 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:29:13.063133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6a6c658b-bb2d-402d-bce5-3641253395c1 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "DELETE /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 204 len: 0 microversion: 2.1 time: 0.110686 Jul 20 19:29:13.063808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 308/622] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:29:12 2022] DELETE /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:29:13.072224 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:13.072877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:13.079094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.079551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.080360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.080805 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.212142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.220342 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d75337bb-1342-4e17-bcdb-17686efe247f tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.151916 Jul 20 19:29:13.220901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 315/623] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:13 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:13.226210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:13.226999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:13.233035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.233475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.234222 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:13.234651 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:13.365518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.373304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.374827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:13.375965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1a6bceee-dcce-492a-aa8c-431efacbff04 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.154083 Jul 20 19:29:13.376549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 309/624] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:13 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:14.237644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.238361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.244923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.245406 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.246195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.246639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.375884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.383316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a7aa7660-0710-4174-979b-c1815790f042 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.149566 Jul 20 19:29:14.383878 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 316/625] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:14.394705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:14.395365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:14.401854 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.402274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.403036 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:14.403463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:14.530553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.538634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.540145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:14.541331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5a272d91-01f6-42c8-aaba-685b341734f9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.150470 Jul 20 19:29:14.541893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 310/626] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:14 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:15.400850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.401868 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.408279 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.408758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.409520 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.409960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.536624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.544080 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-507bf8c1-5f1e-4166-b6e3-0f301d178241 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.147242 Jul 20 19:29:15.544678 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 317/627] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:15.558878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:15.559476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:15.566229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.566675 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.567428 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:15.567857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:15.699777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.707669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.709212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:15.710360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a72610b3-5ebf-4484-a7bf-9f9cde289034 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.155421 Jul 20 19:29:15.710919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 311/628] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:15 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:16.561548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.562150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.569305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.570396 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.570585 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.570983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.701635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.708999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d641a67a-058e-4068-bab3-542f0d6aa5aa tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1521 microversion: 2.1 time: 0.151883 Jul 20 19:29:16.709567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 318/629] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:16.728272 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:16.728904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:16.735305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.735899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.736824 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:16.737257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:16.862206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.871150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.872742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:16.873884 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e279eee2-5ae5-48ab-a95e-0c16302eefe0 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.149432 Jul 20 19:29:16.874468 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 312/630] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:16 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:17.411678 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-55beced8-c0b3-470a-847a-45fdd8bf6ec6 req-9d02feff-c47c-45e2-9674-b36f2299c61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057f48c6-98d1-43fb-ab77-526c7ff0cf07", "name": "network-vif-deleted", "tag": "b88207bd-7c1f-4302-9d14-7ef3931098c7"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:17.421337 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-55beced8-c0b3-470a-847a-45fdd8bf6ec6 req-9d02feff-c47c-45e2-9674-b36f2299c61b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.421776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-55beced8-c0b3-470a-847a-45fdd8bf6ec6 req-9d02feff-c47c-45e2-9674-b36f2299c61b service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.433152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-55beced8-c0b3-470a-847a-45fdd8bf6ec6 req-9d02feff-c47c-45e2-9674-b36f2299c61b service nova] Creating event network-vif-deleted:b88207bd-7c1f-4302-9d14-7ef3931098c7 for instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 on hv-cinder-81914 Jul 20 19:29:17.438322 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-55beced8-c0b3-470a-847a-45fdd8bf6ec6 req-9d02feff-c47c-45e2-9674-b36f2299c61b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Jul 20 19:29:17.438918 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 319/631] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:17.725716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:17.726315 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:17.732984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.733568 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.734184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.734613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.767336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.767796 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.768229 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lazy-loading 'fault' on Instance uuid 057f48c6-98d1-43fb-ab77-526c7ff0cf07 {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:17.810637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb06eeba738b452fab3986de7e1f7856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f63357734c4efa9a88c07996aa5551', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:17.818505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-094926fe-a09d-4dfe-8dbd-3d93cd7a8bce tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 200 len: 1312 microversion: 2.1 time: 0.096601 Jul 20 19:29:17.825424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 313/632] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:17 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:17.893754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:17.894455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:17.900714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.901169 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:17.902503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:17.902955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.038750 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.046661 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.048188 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:18.049373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f83bf4bf-c04f-4282-aebf-f6ad80887c66 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.160700 Jul 20 19:29:18.049934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 320/633] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:17 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:18.834905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:18.835495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] [instance: 057f48c6-98d1-43fb-ab77-526c7ff0cf07] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:18.843738 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:18.844206 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.844963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:18.845394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:18.859034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] HTTP exception thrown: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Request method failure captured: Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 HTTP/1.1 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZIvF9ugpYe7-0EakHvix28xoFUPQn3x00w9KlsVzx0MTq9fViqd6xYxIRuVykPcSdM1tmeO8WbrYvngtZjMNZUDCwo9vCvRY7cqq20wFulaUk9Q9wgJPdKIVPxV2mqDDKlGy4LzA80A3dKZgYxMkIipqBj12PxR2ekvxmnIcoYR20 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:29:18.860715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f0f63357734c4efa9a88c07996aa5551"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f0f63357734c4efa9a88c07996aa5551", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f0f63357734c4efa9a88c07996aa5551"}]}] Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: f0f63357734c4efa9a88c07996aa5551 Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796605797 Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: cb06eeba738b452fab3986de7e1f7856 Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796605797-project Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. Jul 20 19:29:18.862234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '057f48c6-98d1-43fb-ab77-526c7ff0cf07'} Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:18.863106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. Jul 20 19:29:18.864501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:29:18.865615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] Returning 404 to user: Instance 057f48c6-98d1-43fb-ab77-526c7ff0cf07 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:18.865615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6626f350-5012-44cb-aac3-3757fed922b5 tempest-ServerRescueNegativeTestJSON-796605797 tempest-ServerRescueNegativeTestJSON-796605797-project] 10.222.0.43 "GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07" status: 404 len: 111 microversion: 2.1 time: 0.031682 Jul 20 19:29:18.865615 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 314/634] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:29:18 2022] GET /compute/v2.1/servers/057f48c6-98d1-43fb-ab77-526c7ff0cf07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:19.067399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:19.068018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:19.075378 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.075857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.076678 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:19.077119 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:19.529477 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.537454 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.538976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:19.540133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-144251b3-9fa0-4dda-b727-313ada54e935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.476978 Jul 20 19:29:19.540732 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 321/635] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:19 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:20.559724 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:20.560361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:20.567885 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.568365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.569146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:20.569586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:20.740456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.752381 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.755187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:20.757099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-35f5f4d1-dd60-4b9e-aec2-c3ab32fb4447 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.201833 Jul 20 19:29:20.758080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 315/636] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:20 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:21.776163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:21.776801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:21.786747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.787198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.787978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:21.788449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:21.927444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.937021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.939618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:21.941135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-159de3e5-4c09-4d9d-b52d-e1f282e91d4a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.169917 Jul 20 19:29:21.941712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 322/637] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:21 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:22.960894 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:22.961624 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:22.968486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.969045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:22.970713 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:22.970713 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:23.108478 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.117179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.118718 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:23.119886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-39a09663-c6f2-44e8-a501-c0bdecebd4be tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1744 microversion: 2.20 time: 0.163016 Jul 20 19:29:23.120476 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 316/638] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:22 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:23.350615 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e1a1a25e-f685-4fc1-9952-a47ebeb059f2 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Action: 'create', calling method: .version_select at 0x7f26c1501f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1499177497", "metadata": {"Type": "work"}}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:23.631090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e1a1a25e-f685-4fc1-9952-a47ebeb059f2 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.401129 Jul 20 19:29:23.631863 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 323/639] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jul 20 19:29:23 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:29:23.642761 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1c7eadda-f89d-417e-a1fb-5914b6ac4210 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c1468ee0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:23.691091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1c7eadda-f89d-417e-a1fb-5914b6ac4210 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 200 len: 353 microversion: 2.1 time: 0.051962 Jul 20 19:29:23.691700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 317/640] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:23 2022] GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:24.139614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.140211 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:24.146346 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.146794 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.147563 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:24.148000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:24.275305 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.283497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.285131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:24.286297 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2793ce23-d671-4b0b-9a00-445e244b3f12 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1744 microversion: 2.20 time: 0.151223 Jul 20 19:29:24.286860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 324/641] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:24.703936 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f15d9ffd-424f-4941-8fd8-6f7c49ebfcbd tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c14f43a0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.755397 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f15d9ffd-424f-4941-8fd8-6f7c49ebfcbd tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 200 len: 354 microversion: 2.1 time: 0.055737 Jul 20 19:29:24.755976 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 318/642] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:24.766581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7b259ba6-6b28-40df-89ad-b9c631b8ed5d tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c1526ca0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.812223 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7b259ba6-6b28-40df-89ad-b9c631b8ed5d tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 200 len: 354 microversion: 2.1 time: 0.049309 Jul 20 19:29:24.812835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 325/643] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:24.824208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f021eed4-5cb7-4b8d-80cf-24c3c66de191 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c1471790>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.885488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f021eed4-5cb7-4b8d-80cf-24c3c66de191 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 202 len: 0 microversion: 2.1 time: 0.064908 Jul 20 19:29:24.886210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 319/644] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:29:24 2022] DELETE /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:24.894105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1c887c7b-6558-4905-b209-2b17027b7176 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c1501f70>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:24.942551 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1c887c7b-6558-4905-b209-2b17027b7176 tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 200 len: 353 microversion: 2.1 time: 0.052144 Jul 20 19:29:24.943495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 326/645] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:24 2022] GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:25.304559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.305214 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:25.311340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.311780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.312554 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:25.312987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:25.463893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.472876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.474412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:25.475575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-73f0907f-1891-4a44-ac5c-4475b595a89b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.175002 Jul 20 19:29:25.476128 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 320/646] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:25.956130 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-42961443-bb4c-4c23-8fed-b8f63db4a7ed tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Calling method '.version_select at 0x7f26c1561ee0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:25.986674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-42961443-bb4c-4c23-8fed-b8f63db4a7ed tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] HTTP exception thrown: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-42961443-bb4c-4c23-8fed-b8f63db4a7ed tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Request method failure captured: Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 HTTP/1.1 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FeTfqD-L4fXAvQNdtiDbJRaf3of__iU-z5PNEPMryaeCibWSQz0pNOI69vKPC-aV6DcqPBF9vPvGw9ybeTObgJaG5lV3cevghIft-oDW19SjyMneYC9InSxdSKb-BQUHGnkUX9Zjkp6np2RvxX9zjQwKUbfegwppM0oAkYAqyUXngw Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: b5a8676f5a1349b08a7741bb53838d16 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesGetTestJSON-732909221 Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:29:25.989094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b5a8676f5a1349b08a7741bb53838d16"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b5a8676f5a1349b08a7741bb53838d16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b5a8676f5a1349b08a7741bb53838d16", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b5a8676f5a1349b08a7741bb53838d16"}]}] Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesGetTestJSON-732909221 Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: b5a8676f5a1349b08a7741bb53838d16 Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesGetTestJSON-732909221 Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesGetTestJSON-732909221-project Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: a0c0becb185f49ff86242fe80a0394c3 Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesGetTestJSON-732909221-project Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '80dbf04c-40e6-4829-8e7e-a82473f74211'} Jul 20 19:29:25.990382 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. (HTTP 404) (Request-ID: req-c8bfa0be-3c64-4c61-93de-fc1ba0829e8f) Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:25.991230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:29:25.992412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:29:25.993528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. Jul 20 19:29:25.994638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:29:25.997020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-42961443-bb4c-4c23-8fed-b8f63db4a7ed tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] Returning 404 to user: Volume 80dbf04c-40e6-4829-8e7e-a82473f74211 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:29:25.997879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-42961443-bb4c-4c23-8fed-b8f63db4a7ed tempest-VolumesGetTestJSON-732909221 tempest-VolumesGetTestJSON-732909221-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211" status: 404 len: 109 microversion: 2.1 time: 0.046364 Jul 20 19:29:25.998437 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 327/647] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:25 2022] GET /compute/v2.1/os-volumes/80dbf04c-40e6-4829-8e7e-a82473f74211 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:26.496606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:26.497332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:26.508704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.509528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.510602 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:26.511350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:26.710922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.721998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.723853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:26.725410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0f3ac252-7f4e-447c-b3f6-8b3251a957d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.234737 Jul 20 19:29:26.726634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 321/648] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:26 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:27.128938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-58350f00-6f71-4368-936e-a8e967e2d5b5 req-3a595751-f695-4829-aa84-2f150b96fe87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "name": "network-vif-plugged", "status": "completed", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:27.140180 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-58350f00-6f71-4368-936e-a8e967e2d5b5 req-3a595751-f695-4829-aa84-2f150b96fe87 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.140883 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-58350f00-6f71-4368-936e-a8e967e2d5b5 req-3a595751-f695-4829-aa84-2f150b96fe87 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.160251 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-58350f00-6f71-4368-936e-a8e967e2d5b5 req-3a595751-f695-4829-aa84-2f150b96fe87 service nova] Creating event network-vif-plugged:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:29:27.167256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-58350f00-6f71-4368-936e-a8e967e2d5b5 req-3a595751-f695-4829-aa84-2f150b96fe87 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043591 Jul 20 19:29:27.168480 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 328/649] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:27.745997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:27.747444 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:27.756801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.757626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.759040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:27.759679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:27.910203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.919386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.921115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:27.922601 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d6854fb6-6dce-4c02-aa7c-8f02e939c747 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.181920 Jul 20 19:29:27.923390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 322/650] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:27 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:28.945444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:28.946142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:28.954266 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.955061 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:28.955492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:28.955932 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.101530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.112178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.114260 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:29.117506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f5966085-0c4a-4869-a02e-14c44a2bd187 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.178858 Jul 20 19:29:29.118191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 329/651] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:28 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:29.184270 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5f4a5401-44c3-4e2a-9b1d-7cab56d6d360 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c14639d0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:29.239533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5f4a5401-44c3-4e2a-9b1d-7cab56d6d360 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e6c5e03b-94b0-40b9-be02-25d4120bf27f" status: 200 len: 351 microversion: 2.1 time: 0.060040 Jul 20 19:29:29.240110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 323/652] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:29 2022] GET /compute/v2.1/os-volumes/e6c5e03b-94b0-40b9-be02-25d4120bf27f => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:29.448483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:29.449954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:29.464201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.464886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.465924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:29.466333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:29.501680 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a2c12722-12cc-43df-bc28-dc0efbfcf5b6 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/ips" status: 200 len: 147 microversion: 2.1 time: 0.287310 Jul 20 19:29:29.502495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 330/653] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:29:29 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/ips => generated 147 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:30.139295 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.140318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.143234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:30.150293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.150777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.151587 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.152018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.319110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.331330 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.332866 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:30.334034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-62e8c4dc-30f7-4fa6-81f4-09dd17b312fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.201900 Jul 20 19:29:30.334586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 324/654] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:30.657068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-130adb62-b04c-4cb8-a298-e7dcacf0a686 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c154e040>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:30.708974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-130adb62-b04c-4cb8-a298-e7dcacf0a686 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/6ca6b057-489a-43b1-a337-70d8a5d2b6cc" status: 200 len: 349 microversion: 2.1 time: 0.056376 Jul 20 19:29:30.718118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 331/655] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:30 2022] GET /compute/v2.1/os-volumes/6ca6b057-489a-43b1-a337-70d8a5d2b6cc => generated 349 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:30.938662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de98cc48-a811-4cf3-80e4-876e130cc9cb"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:30.940506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:30.947398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.947845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:30.948849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:30.950161 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.053818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:31.257365 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-805b7fa0-f44c-48b6-b6c9-9d74e12eea00 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323472 Jul 20 19:29:31.258439 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 325/656] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:29:30 2022] POST /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:31.358193 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:31.358905 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:31.366774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.368026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.369028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:31.369573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:31.535112 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.544422 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.546220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:31.547389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d17fc2fe-86ed-4e7b-8df1-f2d9ddbddc23 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.195811 Jul 20 19:29:31.547940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 332/657] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:31 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:32.117945 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-27675ab6-d840-4bbf-a0d2-7a6b3060a2dc tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c158de50>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.171572 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-27675ab6-d840-4bbf-a0d2-7a6b3060a2dc tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/d908698e-5d66-4a31-88a9-3d3a5c8bc982" status: 200 len: 350 microversion: 2.1 time: 0.058551 Jul 20 19:29:32.172146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 326/658] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes/d908698e-5d66-4a31-88a9-3d3a5c8bc982 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:32.183654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-276e25c8-c3e1-4642-bcd6-854ab9b1e5a2 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c154e0d0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.271310 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-276e25c8-c3e1-4642-bcd6-854ab9b1e5a2 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091391 Jul 20 19:29:32.271877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 333/659] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:32.284874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c0682544-7dc6-450e-a8cc-6301aec2830e tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c15fcca0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.400145 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c0682544-7dc6-450e-a8cc-6301aec2830e tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.119465 Jul 20 19:29:32.403273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 327/660] 10.222.0.43 () {58 vars in 1148 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:32.413610 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-320cdaac-2846-4f24-a4ba-d81fa9d70ca3 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c1526790>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.505036 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-320cdaac-2846-4f24-a4ba-d81fa9d70ca3 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.095325 Jul 20 19:29:32.512189 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 334/661] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:29:32.517162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a2ab94c1-2289-471c-aaf0-329cac73da4a tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c157ed30>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.566522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.567270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:32.575439 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.576632 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.577435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:32.579274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:32.611131 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a2ab94c1-2289-471c-aaf0-329cac73da4a tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097401 Jul 20 19:29:32.618921 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 328/662] 10.222.0.43 () {58 vars in 1166 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:32.624559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-37b6a48d-224c-407f-b550-43edfb6300a8 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c13ff3a0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.735633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-37b6a48d-224c-407f-b550-43edfb6300a8 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.115360 Jul 20 19:29:32.736235 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 329/663] 10.222.0.43 () {58 vars in 1169 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:32.749914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cadb9968-1de1-4e3d-b717-b0085fd0697c tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c1463f70>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:32.764670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.780663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.782527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:32.783944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c8c81f76-32ce-451c-b6be-be7b4e061e79 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.221641 Jul 20 19:29:32.798395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 335/664] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:32.849327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cadb9968-1de1-4e3d-b717-b0085fd0697c tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.103589 Jul 20 19:29:32.856917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 330/665] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:32.866279 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f1fb0bf4-d2f5-454b-afee-512d139e1b07 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c15345e0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.108391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f1fb0bf4-d2f5-454b-afee-512d139e1b07 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.249746 Jul 20 19:29:33.115721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 336/666] 10.222.0.43 () {58 vars in 1187 bytes} [Wed Jul 20 19:29:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:33.121500 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-02b886ae-0441-4422-950b-bf6ec8e335d7 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] Calling method '.version_select at 0x7f26c13ffe50>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.216982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-02b886ae-0441-4422-950b-bf6ec8e335d7 tempest-VolumesTestJSON-205029297 tempest-VolumesTestJSON-205029297-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.100209 Jul 20 19:29:33.217925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 331/667] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:29:33.805485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:33.806754 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:33.808982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:33.819286 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.820546 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.821338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:33.821779 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:33.977197 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.988715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.990605 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:33.991902 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-750eb49f-846d-487b-b5d3-318ccdc9776a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.191264 Jul 20 19:29:33.992578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 337/668] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:33 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:35.011791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:35.012469 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:35.021044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.021744 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.022703 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:35.023151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:35.167248 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.176995 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.178662 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:35.180000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6cba039a-e98a-4715-910c-5de749a038e9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1739 microversion: 2.20 time: 0.173220 Jul 20 19:29:35.180735 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 332/669] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:35 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:36.199201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:36.199796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:36.206360 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.206804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.207697 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:36.208015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:36.227372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:36.657615 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.676451 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.679637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:36.680921 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9c784413-a18e-4fe2-b9a6-53b89a82e83c tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1721 microversion: 2.20 time: 0.485717 Jul 20 19:29:36.681493 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 338/670] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:36 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:37.698916 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:37.699524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:37.705737 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.706198 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.706964 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:37.707404 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:37.847967 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.856777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.858300 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:37.859631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b714ae7f-f331-4354-9ac5-5fe42ea4f306 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1721 microversion: 2.20 time: 0.164652 Jul 20 19:29:37.860192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 333/671] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:37 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:38.878906 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:38.879489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:38.886745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.887204 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:38.887978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:38.888452 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.020347 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.029802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.031267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:39.032458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7918862a-5de2-4789-9ef6-a546dcdec201 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1724 microversion: 2.20 time: 0.157444 Jul 20 19:29:39.033213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 339/672] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:38 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:39.051106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87705685-4f14-4e88-bf0d-c9b2847973d3"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:39.052280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.058757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.059211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.059954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.060411 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.327978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9c9a4575-4a7a-4fe6-9da7-ddfdb52c7933 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280695 Jul 20 19:29:39.329006 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 334/673] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jul 20 19:29:39 2022] POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 19:29:39.463377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.464129 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.470717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.471110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.471875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.472332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.752012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9f8b4091-7e77-4b64-b192-dc874681b57e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments/87705685-4f14-4e88-bf0d-c9b2847973d3" status: 202 len: 0 microversion: 2.20 time: 0.292628 Jul 20 19:29:39.755964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 340/674] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jul 20 19:29:39 2022] DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments/87705685-4f14-4e88-bf0d-c9b2847973d3 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:29:39.807655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:39.808757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.815157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.815634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.816439 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.816880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.940458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.941434 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:39.948677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.949769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.950749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:39.951362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:39.985449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-16f2f721-69cd-43b6-967f-7f141da691d9 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Jul 20 19:29:39.986165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 341/675] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:39.996118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:39.997028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.003070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.003515 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.004274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.004729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.034964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-caf090df-d232-4a91-bf39-26e52990853b tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb" status: 200 len: 194 microversion: 2.1 time: 0.042965 Jul 20 19:29:40.035670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 342/676] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 19:29:39 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:40.053708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ca4eaa8a-24bb-4a8e-84d2-0449635a5c3b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/action" status: 202 len: 0 microversion: 2.20 time: 0.249891 Jul 20 19:29:40.054938 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 335/677] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jul 20 19:29:39 2022] POST /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:29:40.064889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:40.065954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:40.074675 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.075230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.076099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:40.076780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:40.258207 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.267827 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.269352 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:40.277164 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1eedc269-71be-4f9d-b7ac-c2acf2224ab3 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1672 microversion: 2.20 time: 0.217024 Jul 20 19:29:40.279255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 343/678] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:40 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:41.115179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-87c88393-344b-4fbf-81fd-1fc1be429610 req-bae5e0a5-a204-49af-8a13-de238fa90ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "name": "network-vif-unplugged", "status": "completed", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:41.125887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-87c88393-344b-4fbf-81fd-1fc1be429610 req-bae5e0a5-a204-49af-8a13-de238fa90ddf service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.126986 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-87c88393-344b-4fbf-81fd-1fc1be429610 req-bae5e0a5-a204-49af-8a13-de238fa90ddf service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.137118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.compute.server_external_events [req-87c88393-344b-4fbf-81fd-1fc1be429610 req-bae5e0a5-a204-49af-8a13-de238fa90ddf service nova] Unable to find a host for instance 69446528-3449-410e-9271-ffb9da39557c. Dropping event network-vif-unplugged {{(pid=117769) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 19:29:41.138019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-87c88393-344b-4fbf-81fd-1fc1be429610 req-bae5e0a5-a204-49af-8a13-de238fa90ddf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026686 Jul 20 19:29:41.138803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 336/679] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 19:29:41.299176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:41.299788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.306344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.306800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.307673 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.308646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.459808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.469816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.471474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:41.472707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3f06189f-5d79-419e-8d88-e0d387a420b4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1674 microversion: 2.20 time: 0.177711 Jul 20 19:29:41.485549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 344/680] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:41 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:41.488798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "806c5635-de51-4808-ae6c-0dc5ff3d7f17"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:41.490179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:41.497358 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.497803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.498562 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:41.499022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:41.865935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3df8e888-50af-42e9-b70e-b06d402c8273 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "POST /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392744 Jul 20 19:29:41.866822 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 337/681] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:29:41 2022] POST /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:42.493561 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:42.494159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:42.500576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.501024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.501776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:42.502206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:42.629433 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.637758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.639277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:42.640455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-63a395fa-d182-4491-ae0e-8f3abed92681 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.150751 Jul 20 19:29:42.641020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 345/682] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:42 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:43.658287 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:43.658973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:43.665561 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.666000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.666755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:43.667184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:43.798980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.806807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.808311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:43.810059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e51b872d-4428-4dde-8935-b8b786e3ce02 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.156033 Jul 20 19:29:43.810613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 338/683] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:43 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:44.829121 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:44.829849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:44.836869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.837473 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.838407 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:44.838911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:44.973021 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.981093 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.982611 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:44.983770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7090d4de-9c77-4d34-b395-bf8d5602d9e2 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.159199 Jul 20 19:29:44.984356 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 346/684] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:44 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:46.004362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:46.005951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:46.015443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.016165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.016990 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:46.017462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:46.238159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.250350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.251897 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:46.253137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0c40c34d-333a-4142-b985-1efa19cbae35 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.254045 Jul 20 19:29:46.254103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 339/685] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:45 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:47.273075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:47.274001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:47.281748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.282363 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.283278 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:47.284039 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:47.429923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.439257 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.441488 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:47.442753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7f3886f1-9ecf-4b71-bee6-f5e8b6e55213 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.173608 Jul 20 19:29:47.443400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 347/686] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:47 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:48.461922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:48.462549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:48.470063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.470541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.471329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:48.471787 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:48.616639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.628633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.631074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:48.632753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e5fdc79f-c757-4844-85ae-9eaed78f3655 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.174738 Jul 20 19:29:48.643409 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 340/687] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:48 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:49.650443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:49.651070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:49.658018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.658163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.658870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:49.659301 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:49.802917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.812628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.814161 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:49.815594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0a992d14-ff52-43d0-8744-804410120bf4 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.169022 Jul 20 19:29:49.816157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 348/688] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:49 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:50.841073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:50.842871 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:50.849659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.850581 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:50.851599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:50.852446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:51.018210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.026107 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.027638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:51.028893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3ebbb6d1-92c8-47b1-8b4e-2826050b8475 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.198323 Jul 20 19:29:51.029452 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 341/689] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:50 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:52.049101 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:52.050397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:52.057514 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.058309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.059335 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:52.059982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:52.208239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.216642 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.218155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:52.219319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f75ad18e-1b74-4b73-86a1-9d285bbdcf73 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.174121 Jul 20 19:29:52.219877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 349/690] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:52 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:53.238066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:53.238691 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:53.245817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.247045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.247873 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:53.248396 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:53.405446 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.407832 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:53.415076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.416597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:53.417770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d486e5b4-4dd3-4b62-a07e-8a82722547d1 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.183609 Jul 20 19:29:53.418872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 342/691] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:53 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:54.437200 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:54.437799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:54.444336 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.444785 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.445576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:54.446007 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:54.581904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.590292 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.591788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:54.593080 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bb16502c-93be-4164-984e-ce3c988fd672 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.160351 Jul 20 19:29:54.593538 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 350/692] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:54 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:55.612398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.612998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.620276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.620737 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.621494 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.621924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.766597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.783948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.785433 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:55.786807 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e7ef31b8-914a-4c57-8882-7cd3eba6101b tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.178674 Jul 20 19:29:55.787792 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 343/693] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:55.942853 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:55.943834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:55.953698 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.954265 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.955090 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:55.956670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:55.987340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-432c3d65-bc78-44f5-84b0-e19ebbda66bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050267 Jul 20 19:29:55.988018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 351/694] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:29:55 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:56.147696 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.148136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.154696 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.155146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.155925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.156386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.185110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dc393beb-6dcf-42a6-a011-f147a737d2e4 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb" status: 200 len: 194 microversion: 2.1 time: 0.041392 Jul 20 19:29:56.185723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 344/695] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 19:29:56 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:56.196684 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.197171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.204989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.205492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.206273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.206715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.282663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:56.288952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lazy-loading 'services' on Instance uuid 2bfc06e5-b70e-443b-9192-6a0af96a58db {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:56.414418 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4c1987ee-f2ae-4a34-96b9-406d2f89d983 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb" status: 202 len: 0 microversion: 2.1 time: 0.222295 Jul 20 19:29:56.415043 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 352/696] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:29:56 2022] DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/de98cc48-a811-4cf3-80e4-876e130cc9cb => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:56.806408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:56.807024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:56.814276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.814997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.815767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:56.816204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:56.948302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.956593 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.958091 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:56.959246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f5f6a5d3-bab3-4c91-8ecb-a09489d06989 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.156827 Jul 20 19:29:56.959960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 345/697] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:56 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:29:57.978194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:57.978831 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:57.985689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.986140 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:57.986909 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:57.987348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.120906 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.129391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.131055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:58.132319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0a28be74-a496-403e-920e-e1a2f57573fa tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.159003 Jul 20 19:29:58.133199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 353/698] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:57 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:58.577524 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:58.578061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:58.584592 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.585039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.585786 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.586225 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.613893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0deef07a-d501-4b82-9b57-9a6755286afc tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/806c5635-de51-4808-ae6c-0dc5ff3d7f17" status: 200 len: 194 microversion: 2.1 time: 0.040841 Jul 20 19:29:58.614398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 346/699] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jul 20 19:29:58 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/806c5635-de51-4808-ae6c-0dc5ff3d7f17 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:29:58.624442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:58.624937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:58.630886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.631344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.632113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:58.632583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:58.713284 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lazy-loading 'services' on Instance uuid 2bfc06e5-b70e-443b-9192-6a0af96a58db {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:29:58.784608 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8593ffad-60cc-42c5-93cd-8cb5af313f33 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/806c5635-de51-4808-ae6c-0dc5ff3d7f17" status: 202 len: 0 microversion: 2.1 time: 0.164356 Jul 20 19:29:58.785320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 354/700] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:29:58 2022] DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments/806c5635-de51-4808-ae6c-0dc5ff3d7f17 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:29:59.151075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.151588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.157475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.157921 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.158681 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.159112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.286790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-90045e22-f52a-4ffd-b754-ac57efd08988 req-be5dd2c3-5a38-431c-88a1-c7d907a5e4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "name": "network-vif-plugged", "status": "completed", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:29:59.300343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-90045e22-f52a-4ffd-b754-ac57efd08988 req-be5dd2c3-5a38-431c-88a1-c7d907a5e4e1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.301003 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-90045e22-f52a-4ffd-b754-ac57efd08988 req-be5dd2c3-5a38-431c-88a1-c7d907a5e4e1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.317786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-90045e22-f52a-4ffd-b754-ac57efd08988 req-be5dd2c3-5a38-431c-88a1-c7d907a5e4e1 service nova] Creating event network-vif-plugged:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:29:59.322968 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.323152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-90045e22-f52a-4ffd-b754-ac57efd08988 req-be5dd2c3-5a38-431c-88a1-c7d907a5e4e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135495 Jul 20 19:29:59.323714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 355/701] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:29:59.332204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.336179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:29:59.336179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4a938ffd-597f-4bbc-bb51-4f7ce0f22cee tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.188340 Jul 20 19:29:59.349754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 347/702] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:29:59.944252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:29:59.945273 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:29:59.951876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.952597 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.953356 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:29:59.953791 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:29:59.981875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6252222d-3390-48d6-9962-362a114e043c tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042258 Jul 20 19:29:59.982412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 356/703] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:29:59 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:30:00.084564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.085528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.091853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.092314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.093073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.093502 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.121012 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7fa315b3-7cd9-481e-a117-6477255d16af tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040341 Jul 20 19:30:00.121486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 348/704] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:30:00.177802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.178316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.184859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.185315 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.186083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.186521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.211910 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:30:00.283768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a1effc62-6f05-4f13-8a43-d385d54bbc71 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 204 len: 0 microversion: 2.1 time: 0.109445 Jul 20 19:30:00.284399 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 357/705] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:30:00 2022] DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:30:00.292360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.292961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.294785 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=40 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:00.302510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.303248 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.304209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.304768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.353994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:00.355002 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:00.360789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.361244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.362017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:00.362455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:00.454517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.462864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0383b1e8-5962-494b-8df9-4e97b7702c98 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.174221 Jul 20 19:30:00.463469 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 349/706] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:00.501994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.510368 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.511923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:00.513171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1d911edd-c3c3-469c-bbe2-61803c7d76db tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.163475 Jul 20 19:30:00.513722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 358/707] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:00 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:01.480536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:01.481172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:01.488454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.488906 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.489637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.490159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.531265 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:01.531874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:01.538391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.538841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.539610 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:01.540048 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:01.623887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.631343 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-67f03b4b-c445-489c-87c0-03ad81c65a50 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.154733 Jul 20 19:30:01.631917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 350/708] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:01 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:01.680773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.688824 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.690621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:01.691783 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-da33bbb5-7bfb-49c0-a336-acd8370ca46d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.164858 Jul 20 19:30:01.692369 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 359/709] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:01 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:02.648453 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.649056 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.655401 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.655842 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.656624 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.657057 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.710181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:02.710787 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:02.717427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.717880 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.718644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:02.719080 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:02.793031 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.801087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a238ffce-b48f-4ecb-8224-53b0e52d27da tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.156508 Jul 20 19:30:02.802012 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 351/710] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:02.851133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.859681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.861386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:02.862534 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6cade8b8-ec7e-4582-8120-4ffdbf477047 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.156276 Jul 20 19:30:02.863087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 360/711] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:02 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:03.819118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:03.819779 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:03.826803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.827154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.827898 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.828357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.881186 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:03.881805 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:03.884701 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:03.893004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.893459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.894279 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:03.894717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:03.993329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.001482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-20a03642-fe71-4d73-85ac-55fcedf2b756 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.186364 Jul 20 19:30:04.004683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 352/712] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:03 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:04.061991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.070915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.072464 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:04.073627 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4e31bd31-bfe6-4634-97c5-42ccd9d98952 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.196297 Jul 20 19:30:04.074185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 361/713] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:03 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:05.018880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:05.019482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:05.025982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.026427 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.027185 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.027616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.091099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:05.092074 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:05.098516 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.098963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.099727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:05.100159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:05.156848 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.165011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-58cfb1e9-d39b-477d-96e3-2bf98c42d67f tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.150023 Jul 20 19:30:05.171953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 353/714] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:05 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:05.233005 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.240804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.242308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:05.243443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7cccf60d-46ce-4465-953a-86e4a35e84d5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.156406 Jul 20 19:30:05.243998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 362/715] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:05 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:06.186419 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:06.187001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:06.193924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.194369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.195124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.195558 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.262081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:06.262727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:06.269558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.270010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.270784 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:06.271221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:06.326412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.342464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0351595f-05de-43dd-b290-4d828c1cab45 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.159893 Jul 20 19:30:06.343051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 354/716] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:06 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:06.416525 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.424479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.426107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:06.427369 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0c7fde25-1a24-4c07-a98c-944bedc6cd07 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1730 microversion: 2.20 time: 0.169164 Jul 20 19:30:06.428018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 363/717] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:06 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:07.359323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:07.360039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:07.366341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.366787 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.367582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.368200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.445712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:07.446246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:07.453288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.453748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.454526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:07.454970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:07.501126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.508618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b26ff963-316f-44d6-877a-66ae29a359bd tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1675 microversion: 2.1 time: 0.153156 Jul 20 19:30:07.509203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 355/718] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:07 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:07.656968 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.664962 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.666463 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:07.667641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4f0dd03c-1a18-476f-ab23-b53c0fdcd0ce tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1717 microversion: 2.20 time: 0.226094 Jul 20 19:30:07.668199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 364/719] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:07 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1717 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 19:30:08.122632 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-6eb12cb5-5b01-4839-8212-7847a14bfccf req-0e2afd14-6adf-4a6d-9800-47606c408202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfc06e5-b70e-443b-9192-6a0af96a58db", "name": "network-vif-deleted", "tag": "e1e7bed1-e7ec-4008-a6b1-b81f384e1cea"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:08.140763 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6eb12cb5-5b01-4839-8212-7847a14bfccf req-0e2afd14-6adf-4a6d-9800-47606c408202 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.141372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6eb12cb5-5b01-4839-8212-7847a14bfccf req-0e2afd14-6adf-4a6d-9800-47606c408202 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.155352 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-6eb12cb5-5b01-4839-8212-7847a14bfccf req-0e2afd14-6adf-4a6d-9800-47606c408202 service nova] Creating event network-vif-deleted:e1e7bed1-e7ec-4008-a6b1-b81f384e1cea for instance 2bfc06e5-b70e-443b-9192-6a0af96a58db on hv-cinder-81914 Jul 20 19:30:08.161367 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-6eb12cb5-5b01-4839-8212-7847a14bfccf req-0e2afd14-6adf-4a6d-9800-47606c408202 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123355 Jul 20 19:30:08.162641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 356/720] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:08.526139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:08.527439 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:08.535546 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.536404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.537247 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.537777 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.574436 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:08.575104 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:08.575648 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lazy-loading 'fault' on Instance uuid 2bfc06e5-b70e-443b-9192-6a0af96a58db {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:30:08.619444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b15f8d66d5104aaeae51e6c1fa3b3596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654a322fff99416595c66a993aeaee17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:08.626780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-22cc33d7-a5d8-45dd-8d51-8dae27ce0fa3 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 200 len: 1328 microversion: 2.1 time: 0.104908 Jul 20 19:30:08.627361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 365/721] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:08 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:09.644427 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.645247 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:09.654371 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.654894 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.655726 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:09.656233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:09.674082 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db HTTP/1.1 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:09.675729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:09.677390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '2bfc06e5-b70e-443b-9192-6a0af96a58db'} Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:09.678174 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:09.679458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:09.680692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:09.680692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f1d2efca-d682-404f-a9f3-c188af7b2011 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 404 len: 111 microversion: 2.1 time: 0.036995 Jul 20 19:30:09.680692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 357/722] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:09 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:30:09.686108 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fde232c3-aeea-418f-9629-121902b40cf5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '.version_select at 0x7f26c1414940>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:09.705556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fde232c3-aeea-418f-9629-121902b40cf5 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095627375" status: 202 len: 0 microversion: 2.1 time: 0.023312 Jul 20 19:30:09.706136 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 366/723] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 19:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095627375 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:30:12.620834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.621633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.631620 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.632069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.632869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.633298 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.646930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db HTTP/1.1 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:12.648536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.650121 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '2bfc06e5-b70e-443b-9192-6a0af96a58db'} Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:12.650930 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.652086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.654067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:12.654067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-3099cd2f-938a-425d-a4ca-e7d6a7d60766 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 404 len: 111 microversion: 2.1 time: 0.035084 Jul 20 19:30:12.654067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 358/724] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:30:12 2022] DELETE /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:30:12.659439 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:12.660049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 2bfc06e5-b70e-443b-9192-6a0af96a58db] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:12.666432 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.667110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.667881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:12.668342 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:12.687770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db HTTP/1.1 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:30:12.689521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.691316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '2bfc06e5-b70e-443b-9192-6a0af96a58db'} Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:12.692162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. Jul 20 19:30:12.693650 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:12.695146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 2bfc06e5-b70e-443b-9192-6a0af96a58db could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:12.695146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-79b9897d-0116-4471-aa48-559d8633db73 tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db" status: 404 len: 111 microversion: 2.1 time: 0.036494 Jul 20 19:30:12.695146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 367/725] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:12 2022] GET /compute/v2.1/servers/2bfc06e5-b70e-443b-9192-6a0af96a58db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:30:13.831212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:13.831710 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:13.838301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.838679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.839434 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.839863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.853497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea HTTP/1.1 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:13.855045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.856600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '58f977b5-705c-46e5-b597-311c97d2edea'} Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:13.857436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.858835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.860243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:13.860243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fd3d7fc2-2d63-40d9-a9a5-23c05a3b9c3d tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 404 len: 111 microversion: 2.1 time: 0.029181 Jul 20 19:30:13.860243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 359/726] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:30:13 2022] DELETE /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:30:13.865221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:13.865860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] [instance: 58f977b5-705c-46e5-b597-311c97d2edea] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:13.876574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.877400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.878719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:13.879503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:13.896652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] HTTP exception thrown: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Request method failure captured: Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea HTTP/1.1 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZVSOdvkoYCpqsoS4EDgazK2gTZbHX7ASKxJnbDSp1FvAPAIexbjtNC5vFblczeBclfZWzQaNWkstz5MXLwUCCFcb92E4u3k2JhDU9w6FWtYrvZ64ycdPvZiVBB_Wav-01KLcEUutGfbq0zLRnO44cTKtUOFKpmO1R2Hu-DnLqaVQ0 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:30:13.898210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/654a322fff99416595c66a993aeaee17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_654a322fff99416595c66a993aeaee17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/654a322fff99416595c66a993aeaee17"}]}] Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 654a322fff99416595c66a993aeaee17 Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeTestJSON-859918001 Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: b15f8d66d5104aaeae51e6c1fa3b3596 Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeTestJSON-859918001-project Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.899769 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '58f977b5-705c-46e5-b597-311c97d2edea'} Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:13.900685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. Jul 20 19:30:13.902105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:13.903430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] Returning 404 to user: Instance 58f977b5-705c-46e5-b597-311c97d2edea could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:13.903430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-246f9ac2-827d-4efa-8dc4-31ca9d21eacf tempest-AttachVolumeTestJSON-859918001 tempest-AttachVolumeTestJSON-859918001-project] 10.222.0.43 "GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea" status: 404 len: 111 microversion: 2.1 time: 0.038342 Jul 20 19:30:13.903430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 368/727] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:13 2022] GET /compute/v2.1/servers/58f977b5-705c-46e5-b597-311c97d2edea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:30:38.398518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:38.400078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:38.403858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=21 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.404927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=87 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.413705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.414498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.415276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.416104 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.468539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f188839d-13ab-4024-99bc-f7e39bbcf8fe tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074164 Jul 20 19:30:38.469479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 360/728] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jul 20 19:30:38 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:38.584412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-291579905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1218028535", "security_groups": [{"name": "tempest-secgroup-smoke-1429967910"}], "block_device_mapping_v2": [{"uuid": "dc844b36-a614-4e17-870e-48b997ea3135", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "667371d0-bd3e-4fe0-a41c-e04f1b0a0f03"}]}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:38.601569 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.602577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:38.615004 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:38.616266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:38.625608 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.629000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.631743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.631743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.681925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:30:38.781116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] validate_networks() for [('667371d0-bd3e-4fe0-a41c-e04f1b0a0f03', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:30:38.798698 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d84e4055-ed32-4d5e-971c-33523236d26e tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 204 len: 0 microversion: 2.20 time: 0.190849 Jul 20 19:30:38.799586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 361/729] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 19:30:38 2022] DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:30:38.821817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:38.826070 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:38.839179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.839859 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:38.841540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:38.842167 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.101300 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.128342 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.131722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.134563 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7e45be07-8f9e-477b-8811-a890d01e7058 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.329374 Jul 20 19:30:39.138896 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 362/730] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:38 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:39.478461 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:30:39.479044 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:30:39.479660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:30:39.480366 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:30:39.480790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:30:39.490583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.491095 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.492228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:39.492882 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:39.511931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:39.515949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Getting quotas for user 4a4f4d585adf40b880be44c29ecd53cd and project 182d5b6ac9e6412b907119a623869c80. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:39.588373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:30:39.590832 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc844b36-a614-4e17-870e-48b997ea3135',volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:30:39.746596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e89a37ee-b4e6-4328-a6a9-396fbb242ea0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167272 Jul 20 19:30:39.748270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 369/731] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:30:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:30:39.758619 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-52f9bc0c-cbc3-469d-a119-b6aba40df1da tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:39.759665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-52f9bc0c-cbc3-469d-a119-b6aba40df1da tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:39.826589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-52f9bc0c-cbc3-469d-a119-b6aba40df1da tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:39.836732 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-52f9bc0c-cbc3-469d-a119-b6aba40df1da tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1094 microversion: 2.1 time: 0.082149 Jul 20 19:30:39.840057 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 363/732] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:39 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:40.167695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.168330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.180728 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.181509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.182415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.182948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.452086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.473222 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.474744 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:40.475931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-589fdf8b-fc69-4250-9620-946612a79e8d tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.323244 Jul 20 19:30:40.479922 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 370/733] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:40.855276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:40.859773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:40.868922 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.870978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:40.872825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:40.873501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.021540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.029891 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-723aedc6-2f86-47c1-a9f2-42fb36fed4cb tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1200 microversion: 2.1 time: 0.178764 Jul 20 19:30:41.046659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 364/734] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:40 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1200 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:41.498964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:41.499660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:41.522293 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.522670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.523443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:41.523877 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:41.971350 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.983974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.985988 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9ac790383bdf4eecaef96cc25fe38553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9c443652a141d482130869ff76c327', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:41.988841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c63f5aca-94e4-4900-8c57-f0501f0bdc18 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 200 len: 1723 microversion: 2.20 time: 0.494380 Jul 20 19:30:41.990094 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 371/735] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:41 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 19:30:42.053999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:42.055456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:42.063139 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.064110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.065835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.066273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.179159 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:42.192924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1a448692-d1ac-4136-bacf-3b0be3e1dae7 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1198 microversion: 2.1 time: 0.142385 Jul 20 19:30:42.194334 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 365/736] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:42 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:42.266573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-10324bc3-efcc-4c28-856d-bab3189f6a43 req-9ed33f3d-02e1-4575-82e6-7b2c0bd8f9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69446528-3449-410e-9271-ffb9da39557c", "name": "network-vif-deleted", "tag": "03a3ef57-93c9-4005-bc98-7bd8a6843360"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:42.280487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-10324bc3-efcc-4c28-856d-bab3189f6a43 req-9ed33f3d-02e1-4575-82e6-7b2c0bd8f9bd service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:42.282494 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-10324bc3-efcc-4c28-856d-bab3189f6a43 req-9ed33f3d-02e1-4575-82e6-7b2c0bd8f9bd service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:42.310272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-10324bc3-efcc-4c28-856d-bab3189f6a43 req-9ed33f3d-02e1-4575-82e6-7b2c0bd8f9bd service nova] Creating event network-vif-deleted:03a3ef57-93c9-4005-bc98-7bd8a6843360 for instance 69446528-3449-410e-9271-ffb9da39557c on hv-cinder-81914 Jul 20 19:30:42.322645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-10324bc3-efcc-4c28-856d-bab3189f6a43 req-9ed33f3d-02e1-4575-82e6-7b2c0bd8f9bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060561 Jul 20 19:30:42.323581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 372/737] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:43.019152 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.022302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.033331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.035400 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.039063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.045158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.061542 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c HTTP/1.1 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:43.064338 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:43.066133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '69446528-3449-410e-9271-ffb9da39557c'} Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:43.067294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:43.068671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:43.069927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:43.069927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f53b8271-f33e-4d13-a70b-f2a3b7dd5bc9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 404 len: 111 microversion: 2.20 time: 0.056608 Jul 20 19:30:43.069927 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 366/738] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:30:43.077678 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-465a1bb8-b673-42a2-bc1a-45d7cb3456d9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '.version_select at 0x7f26c1437280>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.105760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-465a1bb8-b673-42a2-bc1a-45d7cb3456d9 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644020211" status: 204 len: 0 microversion: 2.20 time: 0.034019 Jul 20 19:30:43.107603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 373/739] 10.222.0.43 () {60 vars in 1261 bytes} [Wed Jul 20 19:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644020211 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 19:30:43.212915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:43.214464 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:43.234269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.235059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.237155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:43.237863 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:43.642379 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:43.656210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1148a19c-b61e-4f6e-9b0d-3f9390fe2f09 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.449015 Jul 20 19:30:43.658296 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 367/740] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:43 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:44.506901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-5adc95b6-ebbb-4a27-89ef-a51ede93a2c9 req-5d3e75ba-f11e-4107-b3a3-08524c365013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7319e9f1-695b-4f3a-a3ea-a2a07532bce6", "tag": "d2fa33bc-fe23-49d5-b13a-86ff922d5120"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:44.534081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-5adc95b6-ebbb-4a27-89ef-a51ede93a2c9 req-5d3e75ba-f11e-4107-b3a3-08524c365013 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.534081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-5adc95b6-ebbb-4a27-89ef-a51ede93a2c9 req-5d3e75ba-f11e-4107-b3a3-08524c365013 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.554607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-5adc95b6-ebbb-4a27-89ef-a51ede93a2c9 req-5d3e75ba-f11e-4107-b3a3-08524c365013 service nova] Creating event network-changed:d2fa33bc-fe23-49d5-b13a-86ff922d5120 for instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 on hv-cinder-81914 Jul 20 19:30:44.570012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-5adc95b6-ebbb-4a27-89ef-a51ede93a2c9 req-5d3e75ba-f11e-4107-b3a3-08524c365013 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452872 Jul 20 19:30:44.571027 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 374/741] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:44.681545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:44.682633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:44.693263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.693716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.694905 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:44.695503 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:44.989805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:44.997442 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c3000aef-187c-4064-a999-f870de587355 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.326202 Jul 20 19:30:44.998009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 368/742] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:44 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:45.547415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:45.548692 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:45.555644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.556370 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.557031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.557823 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.594158 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c HTTP/1.1 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:30:45.596063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.598131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '69446528-3449-410e-9271-ffb9da39557c'} Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:45.599427 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.602244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.609567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:45.609567 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-84626bf3-3dbf-4f3c-94ad-2a76b34da91a tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 404 len: 111 microversion: 2.20 time: 0.067056 Jul 20 19:30:45.609720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 375/743] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 19:30:45 2022] DELETE /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:30:45.622569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:45.623591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: 69446528-3449-410e-9271-ffb9da39557c] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:45.633698 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.634353 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.635636 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:45.636423 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:45.663230 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c HTTP/1.1 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:45.666008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.667653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '69446528-3449-410e-9271-ffb9da39557c'} Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:45.669137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. Jul 20 19:30:45.671024 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:45.672599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance 69446528-3449-410e-9271-ffb9da39557c could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:45.672599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1d7944c6-d864-4264-8805-2e98e25c47a5 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c" status: 404 len: 111 microversion: 2.20 time: 0.052596 Jul 20 19:30:45.672599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 369/744] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:45 2022] GET /compute/v2.1/servers/69446528-3449-410e-9271-ffb9da39557c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:30:46.016733 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.017886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.024739 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.025191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.026172 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.026775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.064205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-772216145", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "networks": [{"uuid": "dfc282ec-1eef-40ce-8830-4e9b4223e710"}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:46.136596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] validate_networks() for [('dfc282ec-1eef-40ce-8830-4e9b4223e710', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:30:46.203217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.211674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bdf3d88c-39e1-4686-9804-7468e9f60efc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.199860 Jul 20 19:30:46.213152 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 376/745] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:46.533911 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:30:46.534366 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:30:46.534980 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:30:46.535460 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:30:46.535878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:30:46.545576 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.546023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.546830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.547281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.564132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Getting quotas for project 7ee2fc4ab6a540cc852d2b3850e6b550. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:46.568910 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Getting quotas for user 44d26a97291e44c78d3a6438d7ab76c5 and project 7ee2fc4ab6a540cc852d2b3850e6b550. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:46.582378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:30:46.585168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:30:46.631855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fdca3921-fe41-4eeb-a28c-f5864b91e25c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571330 Jul 20 19:30:46.632828 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 370/746] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:30:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:30:46.642992 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ff41f5ad-b0aa-4500-84bd-197874402cd5 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.644213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ff41f5ad-b0aa-4500-84bd-197874402cd5 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.707544 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ff41f5ad-b0aa-4500-84bd-197874402cd5 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:46.716659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ff41f5ad-b0aa-4500-84bd-197874402cd5 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1218 microversion: 2.1 time: 0.077946 Jul 20 19:30:46.717232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 377/747] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:46.845527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.846134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.853362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.854172 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.855226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.855925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.875843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 HTTP/1.1 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:30:46.877960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.880728 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'b30e5793-20b0-4600-b897-6f3c2de29b83'} Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:46.882301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.885252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.889723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:46.889723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-baaa5161-3404-4671-a952-777e61fd2935 tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 404 len: 111 microversion: 2.20 time: 0.039556 Jul 20 19:30:46.889723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 371/748] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jul 20 19:30:46 2022] DELETE /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:30:46.892545 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:46.893217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] [instance: b30e5793-20b0-4600-b897-6f3c2de29b83] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:46.900648 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.901135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.901135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:46.901135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:46.926850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] HTTP exception thrown: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Request method failure captured: Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 HTTP/1.1 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FZUiQh6bF3jF5EHPnIW5DDoKHEKOXTSLr8d5ObUIesWH_xwX38r1-w63ctuB8PF5wvrOQ3xrsCDSwtJh5QXfZDiQJME2btkZYDbFdS6J-hxoxvROoex8SyV5b8ILYvfdocq3tqjO8gM1ZiBZVmOv48T4RMCHHgRoEon0Axy4__kgvI Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:30:46.928937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff9c443652a141d482130869ff76c327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff9c443652a141d482130869ff76c327", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff9c443652a141d482130869ff76c327"}]}] Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ff9c443652a141d482130869ff76c327 Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1794805568 Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 9ac790383bdf4eecaef96cc25fe38553 Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1794805568-project Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.931736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'b30e5793-20b0-4600-b897-6f3c2de29b83'} Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:30:46.934556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. Jul 20 19:30:46.938912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:30:46.946437 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] Returning 404 to user: Instance b30e5793-20b0-4600-b897-6f3c2de29b83 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:30:46.946437 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bbcff996-4b31-4197-9122-2cb58424141f tempest-AttachVolumeShelveTestJSON-1794805568 tempest-AttachVolumeShelveTestJSON-1794805568-project] 10.222.0.43 "GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83" status: 404 len: 111 microversion: 2.20 time: 0.044134 Jul 20 19:30:46.946437 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 378/749] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jul 20 19:30:46 2022] GET /compute/v2.1/servers/b30e5793-20b0-4600-b897-6f3c2de29b83 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 19:30:47.232329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.233233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.241601 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.242298 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.243108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.243850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.470123 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.478580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ee444b26-fa8d-4341-bd20-0637ac33005c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.251965 Jul 20 19:30:47.479164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 372/750] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:47.739393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:47.739979 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:47.748781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.749603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.750405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:47.750849 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:47.890266 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:47.902045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7d006d1b-6b23-4845-98ed-1b1469f4394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1278 microversion: 2.1 time: 0.168531 Jul 20 19:30:47.905547 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 379/751] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:47 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:48.497645 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.498721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.509580 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.510796 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.512648 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.513678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.751200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:48.771135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8f7e60f6-12db-48d7-b9b8-b3efcb31bcfc tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.278563 Jul 20 19:30:48.773063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 373/752] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:30:48.922703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:48.923549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:48.930607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.931357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:48.933139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:48.933715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.267423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:49.287897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9c6f34e0-b137-488d-bd91-83a73bc9c1df tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.359268 Jul 20 19:30:49.288882 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 380/753] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:48 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:49.790073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:49.790959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:49.798509 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.799619 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:49.800671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:49.801959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.186184 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.198630 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d2c98ab1-9fe8-4a00-afac-8b24c11fccaa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.412487 Jul 20 19:30:50.211449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 374/754] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:49 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:50.273657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:50.286893 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-d7fd5694-77ec-4c80-bd37-62f1be15dfa2 req-2e09c317-53cd-4f76-bc43-04a52d35e462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "290d87da-fb62-4dd2-a709-5c033f6b07bd", "tag": "5543d4ab-0c29-4d6d-afca-f4861da188ba"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:50.295639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-d7fd5694-77ec-4c80-bd37-62f1be15dfa2 req-2e09c317-53cd-4f76-bc43-04a52d35e462 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.296087 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-d7fd5694-77ec-4c80-bd37-62f1be15dfa2 req-2e09c317-53cd-4f76-bc43-04a52d35e462 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.305257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:50.306093 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:50.316722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-d7fd5694-77ec-4c80-bd37-62f1be15dfa2 req-2e09c317-53cd-4f76-bc43-04a52d35e462 service nova] Creating event network-changed:5543d4ab-0c29-4d6d-afca-f4861da188ba for instance 290d87da-fb62-4dd2-a709-5c033f6b07bd on hv-cinder-81914 Jul 20 19:30:50.323537 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.323983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.325532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:50.325969 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:50.331501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-d7fd5694-77ec-4c80-bd37-62f1be15dfa2 req-2e09c317-53cd-4f76-bc43-04a52d35e462 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058744 Jul 20 19:30:50.342164 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 381/755] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:30:50.550368 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:50.559767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c56bf635-3b38-48ca-9787-8cc4556c086f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.257221 Jul 20 19:30:50.571461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 375/756] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:50 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:51.217425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.218281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.226240 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.226728 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.227510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.227977 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.467250 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:51.478353 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-01839d9b-8946-420f-9b70-c03b5619894c tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.266261 Jul 20 19:30:51.482558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 382/757] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:51.578215 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:51.579357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:51.593313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.593850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.594948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:51.595579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:51.941197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:51.953346 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-068feddd-015a-4747-9765-63d0a951d160 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.379331 Jul 20 19:30:51.954445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 376/758] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:51 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:52.499917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.500588 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.506745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.507191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.507952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.508412 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.653855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:52.661879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-813fac9f-2784-4198-873b-313399bfa4e6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.166914 Jul 20 19:30:52.662533 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 383/759] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:52.980312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:52.982027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:52.989204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.989899 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:52.990821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:52.991405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.158492 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.167599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-27f8bb0b-0eeb-418e-bd77-f5034ee42fd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.191085 Jul 20 19:30:53.168187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 377/760] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:52 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:53.678310 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:53.678996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:53.685586 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.686125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.686901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:53.687332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:53.870527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:53.878510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ebb9d5c2-a18c-40bd-ac79-eeb0e8c5946b tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.203910 Jul 20 19:30:53.879197 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 384/761] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:53 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:54.189213 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.191105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.203822 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.204403 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.205386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.205893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.229758 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:54.426437 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:54.435316 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-298dc196-b3cb-405c-8c97-ea4d9e61071b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.253853 Jul 20 19:30:54.435903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 378/762] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:54.898552 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:54.899994 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:54.911275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.911736 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:54.912944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:54.913571 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.074477 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.084037 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-42ebc2e7-41ba-4623-81e8-6d1d2216032f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.190291 Jul 20 19:30:55.084680 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 385/763] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:54 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:55.452937 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:55.453539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:55.459818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.460266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.461080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:55.461514 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:55.723510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:55.734939 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b5fb9f6f-b131-4b1c-a621-fcc5ea0d9cd9 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.286265 Jul 20 19:30:55.744605 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 379/764] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:55 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:56.102198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.103667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.111745 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.114665 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.117151 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.118029 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.286337 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:56.295530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-201e43e2-130b-46ea-836c-498a7d0c1971 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.197690 Jul 20 19:30:56.296497 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 386/765] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:56.752712 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:56.754017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:56.756780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:56.757660 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=8 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:56.766208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.767146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:56.768137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:56.769169 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.011016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.025231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c3dc63b5-2a8a-4e28-8720-28615943d42f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.276861 Jul 20 19:30:57.026118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 380/766] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:56 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:57.313183 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:57.314686 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:57.320790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=8 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:57.324206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.325741 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.326759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:57.327407 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:57.541374 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:57.550708 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3cbc0c51-e01d-4ac3-a93b-73e8254acf88 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.241796 Jul 20 19:30:57.562073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 387/767] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:57 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.043361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.045162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.051575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.052477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.053435 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.054032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.338634 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.349823 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0a81db14-ae87-4e5f-821b-68777c0f6ac2 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.310515 Jul 20 19:30:58.350746 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 381/768] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.569963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:58.571784 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:58.579901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.580504 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.581701 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:58.582245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:58.713130 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c59cad51-c2f0-41e2-a635-44f0632b98e5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: .version_select at 0x7f26c14635e0>, body: {"keypair": {"name": "tempest-keypair-59061762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLzxE7FCi0/84deGqH71WJA99ADdgbG/U5hfscba3Th/i+SZAfI8HceM6bv9rJfgb8OCUsr2iTGMdNkywqNyPe9y2vfxR2gDlm+bhw8Vq4ejCQs4RhKNevTSNmi5i1oLQ=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:30:58.729462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-c59cad51-c2f0-41e2-a635-44f0632b98e5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:30:58.735153 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-c59cad51-c2f0-41e2-a635-44f0632b98e5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:30:58.748792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:58.760280 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4352f5d4-4bd5-4f96-b1f9-a60736f84528 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.195103 Jul 20 19:30:58.769943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 388/769] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:58 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:58.771961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c59cad51-c2f0-41e2-a635-44f0632b98e5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.185634 Jul 20 19:30:58.772616 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 382/770] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:30:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:30:59.366984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.367526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.379404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.379859 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.380991 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.381434 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.607282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.623564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e9b7e867-be0f-4532-ae71-28047fffdd59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.260382 Jul 20 19:30:59.624196 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 389/771] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:30:59.777329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:30:59.778540 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:30:59.785065 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.785617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.786667 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:30:59.788811 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:30:59.960703 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:30:59.970416 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-53e2cf3f-a583-4d7e-83f0-4fd48845db89 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.196759 Jul 20 19:30:59.971542 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 383/772] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:30:59 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.315637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-936274345", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1f9468-ee30-4ff5-9d99-0240a7903291"}], "security_groups": [{"name": "tempest-securitygroup--2073418753"}], "key_name": "tempest-keypair-59061762", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:00.421607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] validate_networks() for [('8d1f9468-ee30-4ff5-9d99-0240a7903291', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:31:00.640575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.641195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.647253 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.647698 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.648497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.648931 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.786458 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.794618 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c9f86bd9-471c-46bb-b90f-d42bba2c1e13 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.157962 Jul 20 19:31:00.795201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 384/773] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:00.798707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:31:00.799191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:31:00.799660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:31:00.800065 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:31:00.800505 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:31:00.809507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.809956 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.810761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:00.811197 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:00.828985 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:31:00.833263 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:31:00.847131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:31:00.849449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:31:00.902024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-115da989-a4e6-421d-9b97-a95d981d6843 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590842 Jul 20 19:31:00.903203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 390/774] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:31:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:31:00.913200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ccf46427-b3b4-45ee-a3df-9730c311b819 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.913893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ccf46427-b3b4-45ee-a3df-9730c311b819 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:00.982299 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ccf46427-b3b4-45ee-a3df-9730c311b819 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:00.994281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ccf46427-b3b4-45ee-a3df-9730c311b819 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1239 microversion: 2.1 time: 0.084538 Jul 20 19:31:00.994624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:00.995224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 385/775] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:00.995356 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.003793 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.004364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.005270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.005793 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.454221 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:01.465393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1c7b9f74-73c3-4f11-9928-b558b9f9a036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.480419 Jul 20 19:31:01.477715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 391/776] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:00 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:01.670998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-eef0952a-0ce1-4deb-b70c-476c579ea59b req-ec4727ce-4dea-41a7-be95-cc09d89c3c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d87da-fb62-4dd2-a709-5c033f6b07bd", "name": "network-vif-plugged", "status": "completed", "tag": "5543d4ab-0c29-4d6d-afca-f4861da188ba"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:01.679177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-eef0952a-0ce1-4deb-b70c-476c579ea59b req-ec4727ce-4dea-41a7-be95-cc09d89c3c5d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.679631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-eef0952a-0ce1-4deb-b70c-476c579ea59b req-ec4727ce-4dea-41a7-be95-cc09d89c3c5d service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.693579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-eef0952a-0ce1-4deb-b70c-476c579ea59b req-ec4727ce-4dea-41a7-be95-cc09d89c3c5d service nova] Creating event network-vif-plugged:5543d4ab-0c29-4d6d-afca-f4861da188ba for instance 290d87da-fb62-4dd2-a709-5c033f6b07bd on hv-cinder-81914 Jul 20 19:31:01.698708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-eef0952a-0ce1-4deb-b70c-476c579ea59b req-ec4727ce-4dea-41a7-be95-cc09d89c3c5d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032294 Jul 20 19:31:01.699319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 386/777] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:01.812245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:01.813001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:01.820674 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.821255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.822230 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:01.822693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:01.827622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=100 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:02.016109 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.017769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.033146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.034457 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.036825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.039188 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.088902 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.109024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1bf21794-a440-4339-ac30-ec774e5caa46 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.301195 Jul 20 19:31:02.110740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 392/778] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:01 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.253730 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.264260 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ae926092-c735-4058-b60b-ad39910a94ed tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1291 microversion: 2.1 time: 0.256885 Jul 20 19:31:02.268098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 387/779] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1291 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:02.483234 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:02.483847 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:02.491817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.492557 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.493529 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:02.494129 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:02.660319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:02.668180 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0ec468b6-fbd9-429d-aa20-dd73c565e743 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.188962 Jul 20 19:31:02.669771 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 393/780] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:02 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:03.127050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.128423 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.135438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.136059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.137067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.137594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.286968 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.288267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.297164 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.298495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.300136 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.300828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.311372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.320203 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-941bbf8d-bd06-4861-8848-97dde0725e92 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.196979 Jul 20 19:31:03.328786 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 388/781] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:03.375558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.385132 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c7a22e14-5da6-4d30-b2e7-70057fa062fc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1297 microversion: 2.1 time: 0.103721 Jul 20 19:31:03.385652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 394/782] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:03.686013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:03.686525 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:03.693112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.693578 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.694392 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.694825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.735134 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-92f4848d-2eb1-4a08-82b6-f5d5468171cf req-75666a1c-3be9-4889-9a73-fd857c374d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7319e9f1-695b-4f3a-a3ea-a2a07532bce6", "name": "network-vif-plugged", "status": "completed", "tag": "d2fa33bc-fe23-49d5-b13a-86ff922d5120"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:03.743492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-92f4848d-2eb1-4a08-82b6-f5d5468171cf req-75666a1c-3be9-4889-9a73-fd857c374d8a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:03.744166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-92f4848d-2eb1-4a08-82b6-f5d5468171cf req-75666a1c-3be9-4889-9a73-fd857c374d8a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:03.754905 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-92f4848d-2eb1-4a08-82b6-f5d5468171cf req-75666a1c-3be9-4889-9a73-fd857c374d8a service nova] Creating event network-vif-plugged:d2fa33bc-fe23-49d5-b13a-86ff922d5120 for instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 on hv-cinder-81914 Jul 20 19:31:03.759965 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-92f4848d-2eb1-4a08-82b6-f5d5468171cf req-75666a1c-3be9-4889-9a73-fd857c374d8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028885 Jul 20 19:31:03.760808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 395/783] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:31:03.831764 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:03.839228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-33c613e6-7796-4774-8608-a84345b0496a tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.157269 Jul 20 19:31:03.839802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 389/784] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:03 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:04.337964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.338654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.345813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.346949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.348131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.348855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.401936 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.402642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.409551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.410156 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.411362 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.411935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.478869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:04.486236 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:04.487532 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-7e1e8795-65e5-4d40-9e89-51c70574b23d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1297 microversion: 2.1 time: 0.089373 Jul 20 19:31:04.488119 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 390/785] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:04.493845 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bfdfd92e-30c3-4e59-a136-39e37b70394a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.160636 Jul 20 19:31:04.494405 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 396/786] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:04.855525 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:04.856708 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:04.862672 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.863117 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.863880 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:04.864340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:04.993561 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.000997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-878a75fd-292a-42a0-8233-c7aad0d9f0e5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.149403 Jul 20 19:31:05.001574 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 391/787] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:04 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:05.504013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:05.504657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:05.511184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.512076 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.512901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:05.513858 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.514685 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.514813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:05.518818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:05.523943 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.524683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.525468 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:05.525908 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:05.586355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.594208 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-291d2fac-970e-4361-a114-ed39a7fda360 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1297 microversion: 2.1 time: 0.093811 Jul 20 19:31:05.594729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 397/788] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:05 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:05.730520 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:05.738813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6dcb67bc-e96a-4c66-917a-f63a1f755bf8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1318 microversion: 2.1 time: 0.231371 Jul 20 19:31:05.739459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 392/789] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:05 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.018002 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.018617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.024748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.025202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.025972 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.026410 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.164145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.173617 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7c220929-b7ce-4d11-b4e8-3e04b9e42932 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.159477 Jul 20 19:31:06.174209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 398/790] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:06.624050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.626017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.639782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.639782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.640320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.640835 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.755512 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:06.756120 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:06.776901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.777370 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.778727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:06.779159 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:06.967656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:06.977695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-797a0576-f8dd-4c90-b89d-08d9df1722b8 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1506 microversion: 2.1 time: 0.226114 Jul 20 19:31:06.978301 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 399/791] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:07.143737 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.153572 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d3ca255b-f6ea-4828-b0a1-d72c21732a25 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.546350 Jul 20 19:31:07.163733 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 393/792] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:06 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:07.197186 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:07.197797 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:07.201978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:07.221304 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.221751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.222543 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.222978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.234957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-72556f3b-81fb-4fde-bde4-f058eb4505e9 req-60676585-a88e-401e-9b0b-134b164bee43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c7e031-3c69-4679-bc2b-2e144ec5952e", "tag": "a87bdbd5-2067-4857-be31-d686671b3573"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:07.253294 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-72556f3b-81fb-4fde-bde4-f058eb4505e9 req-60676585-a88e-401e-9b0b-134b164bee43 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:07.256017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-72556f3b-81fb-4fde-bde4-f058eb4505e9 req-60676585-a88e-401e-9b0b-134b164bee43 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:07.278268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-72556f3b-81fb-4fde-bde4-f058eb4505e9 req-60676585-a88e-401e-9b0b-134b164bee43 service nova] Creating event network-changed:a87bdbd5-2067-4857-be31-d686671b3573 for instance e4c7e031-3c69-4679-bc2b-2e144ec5952e on hv-cinder-81914 Jul 20 19:31:07.293100 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-72556f3b-81fb-4fde-bde4-f058eb4505e9 req-60676585-a88e-401e-9b0b-134b164bee43 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063886 Jul 20 19:31:07.296548 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 394/793] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:07.436971 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:07.449784 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-29cb5e27-5929-47bc-9282-73bf789d6e1e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1266 microversion: 2.1 time: 0.261737 Jul 20 19:31:07.451294 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 400/794] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:07 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:08.172054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.172960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.180963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.181763 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.183103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.183957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.344487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.352635 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1fc12545-f1c6-44f3-9d77-d1a5050a3724 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.185134 Jul 20 19:31:08.353398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 395/795] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:08.468343 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.468938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.475517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.475970 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.476828 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.477272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.615256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.623403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1dad1752-1477-44fc-a9f7-7ee3266a046e tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1453 microversion: 2.1 time: 0.159085 Jul 20 19:31:08.623975 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 401/796] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:08.640386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:08.641287 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:08.649196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.649756 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.651278 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:08.651833 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:08.784730 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:08.792394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-56d441d8-b9f6-4798-ba6a-e0b32fd34fe0 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1453 microversion: 2.1 time: 0.156217 Jul 20 19:31:08.793042 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 396/797] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:08 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:09.373593 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:09.374336 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:09.381194 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.382077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.383146 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:09.383775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:09.718540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:09.726891 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-99293886-9458-48d1-9061-1e4cd685d4e7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.358886 Jul 20 19:31:09.727609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 402/798] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:09 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:10.741496 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-2060b437-e8a6-4f4f-a807-29f03d4b5e41 req-c78f9cc1-3eec-416f-ae94-df254a6accde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7319e9f1-695b-4f3a-a3ea-a2a07532bce6", "tag": "d2fa33bc-fe23-49d5-b13a-86ff922d5120"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:10.744060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:10.744695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:10.751621 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.752073 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.752805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-2060b437-e8a6-4f4f-a807-29f03d4b5e41 req-c78f9cc1-3eec-416f-ae94-df254a6accde service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.752982 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:10.753300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.753571 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-2060b437-e8a6-4f4f-a807-29f03d4b5e41 req-c78f9cc1-3eec-416f-ae94-df254a6accde service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:10.768661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-2060b437-e8a6-4f4f-a807-29f03d4b5e41 req-c78f9cc1-3eec-416f-ae94-df254a6accde service nova] Creating event network-changed:d2fa33bc-fe23-49d5-b13a-86ff922d5120 for instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 on hv-cinder-81914 Jul 20 19:31:10.774320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-2060b437-e8a6-4f4f-a807-29f03d4b5e41 req-c78f9cc1-3eec-416f-ae94-df254a6accde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037314 Jul 20 19:31:10.775440 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 397/799] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:10.818870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:10.841742 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:10.909424 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:10.919001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1e5bfbb9-52e7-4307-aa7b-359d9ed5f421 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.178291 Jul 20 19:31:10.920135 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 403/800] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:10 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:11.532957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:11.537487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-884e685b-3e7c-49ba-b53f-74e78d5b4950 req-2f77f49a-b2ce-4151-8822-f34e26ad5f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c7e031-3c69-4679-bc2b-2e144ec5952e", "name": "network-vif-plugged", "status": "completed", "tag": "a87bdbd5-2067-4857-be31-d686671b3573"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:11.546825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-884e685b-3e7c-49ba-b53f-74e78d5b4950 req-2f77f49a-b2ce-4151-8822-f34e26ad5f44 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.547432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-884e685b-3e7c-49ba-b53f-74e78d5b4950 req-2f77f49a-b2ce-4151-8822-f34e26ad5f44 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.560443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-884e685b-3e7c-49ba-b53f-74e78d5b4950 req-2f77f49a-b2ce-4151-8822-f34e26ad5f44 service nova] Creating event network-vif-plugged:a87bdbd5-2067-4857-be31-d686671b3573 for instance e4c7e031-3c69-4679-bc2b-2e144ec5952e on hv-cinder-81914 Jul 20 19:31:11.566979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-884e685b-3e7c-49ba-b53f-74e78d5b4950 req-2f77f49a-b2ce-4151-8822-f34e26ad5f44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 Jul 20 19:31:11.567683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 398/801] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:11.937261 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:11.939503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:11.949038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.949494 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:11.950484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:11.950925 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:12.138902 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:12.148239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3284a2e2-6f25-46a8-88ef-f3d7736c9ff6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.216503 Jul 20 19:31:12.150431 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 404/802] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:11 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:13.167516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:13.168915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:13.175110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.175551 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.176332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:13.176766 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:13.315134 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:13.319040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=100 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:13.329914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0dca045b-7603-4eef-badd-1affab982fc4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1365 microversion: 2.1 time: 0.167094 Jul 20 19:31:13.330672 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 399/803] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:13 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:14.353842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:14.354255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:14.364842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.365478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.366375 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.366916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.593876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:14.602800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2159e112-4ece-41b4-9f00-16023ffeba8f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1556 microversion: 2.1 time: 0.259406 Jul 20 19:31:14.603522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 405/804] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:14 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1556 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:14.620818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:14.622191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:14.629124 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.629653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.630389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:14.631036 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:14.753260 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-24b3d42b-2355-4d37-99bd-95275e5ac47e tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137598 Jul 20 19:31:14.754162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 400/805] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:31:14 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:16.523734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-522b42fa-d9cc-46fe-b1e2-a4b71a12a654 req-e618af26-3690-43dc-9b75-e3fcbd771012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4c7e031-3c69-4679-bc2b-2e144ec5952e", "tag": "a87bdbd5-2067-4857-be31-d686671b3573"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:16.534067 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-522b42fa-d9cc-46fe-b1e2-a4b71a12a654 req-e618af26-3690-43dc-9b75-e3fcbd771012 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:16.534664 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-522b42fa-d9cc-46fe-b1e2-a4b71a12a654 req-e618af26-3690-43dc-9b75-e3fcbd771012 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:16.546857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-522b42fa-d9cc-46fe-b1e2-a4b71a12a654 req-e618af26-3690-43dc-9b75-e3fcbd771012 service nova] Creating event network-changed:a87bdbd5-2067-4857-be31-d686671b3573 for instance e4c7e031-3c69-4679-bc2b-2e144ec5952e on hv-cinder-81914 Jul 20 19:31:16.554234 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-522b42fa-d9cc-46fe-b1e2-a4b71a12a654 req-e618af26-3690-43dc-9b75-e3fcbd771012 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033275 Jul 20 19:31:16.560747 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 406/806] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:31:23.806157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e1cce406-64c1-4c1c-93f7-c14348475532 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Action: 'create', calling method: .version_select at 0x7f26c141b310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1370730037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENY+Bs3dmZw7Sw6ke2WQx8IclNaskk6WuWAANVzqr3lZ1+ZQqIlHuBn08Oy7lA69BgIy5XF7+PpoS7jPuvBl3LZrOwJ3O47LWSMIodjdFoHXg6/Dw4tGv+FMlYU5N30GA=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:23.825909 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-e1cce406-64c1-4c1c-93f7-c14348475532 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Getting quotas for project 4e5d98e3bb2a4708a934a15674033c12. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:31:23.831151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-e1cce406-64c1-4c1c-93f7-c14348475532 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Getting quotas for user e1e97b329ce34e8ca7ca7d3e046a3136 and project 4e5d98e3bb2a4708a934a15674033c12. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:31:23.855738 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e1cce406-64c1-4c1c-93f7-c14348475532 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.220945 Jul 20 19:31:23.856375 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 401/807] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:31:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:24.585834 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b29fa1d3-ac79-4eb2-b88c-9011733cfffb", "device": "/dev/sdb"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:24.587752 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:24.594772 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.595225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.595998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:24.596485 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:24.879793 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-571268f9-9166-412c-80ed-20ce1194c7f3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "POST /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299277 Jul 20 19:31:24.880524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 407/808] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:31:24 2022] POST /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:43.321266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:43.322084 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:43.322808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:43.327202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-601760972", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1370730037", "security_groups": [{"name": "tempest-secgroup-smoke-1826507732"}], "networks": [{"uuid": "da086bb2-bc6c-45b9-a08e-84bd24f82403"}], "block_device_mapping_v2": [{"uuid": "43223d38-b929-4214-aece-b897c9a7bf0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:43.439625 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] validate_networks() for [('da086bb2-bc6c-45b9-a08e-84bd24f82403', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:31:43.798194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:31:43.798555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:31:43.799023 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:31:43.799429 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:31:43.799836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:31:43.808740 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.809185 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.809978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:43.810412 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:43.826830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Getting quotas for project 4e5d98e3bb2a4708a934a15674033c12. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:31:43.831248 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Getting quotas for user e1e97b329ce34e8ca7ca7d3e046a3136 and project 4e5d98e3bb2a4708a934a15674033c12. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:31:43.886320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:31:43.888414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43223d38-b929-4214-aece-b897c9a7bf0b',volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:31:44.014005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-943a363a-c89c-4d53-8805-4b16273b6b2e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694092 Jul 20 19:31:44.014657 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 402/809] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:31:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:31:44.022826 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=14 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:44.023591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:44.027738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b98d4954-9e1c-4099-a1e6-b1e343c251d9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:44.028454 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b98d4954-9e1c-4099-a1e6-b1e343c251d9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:44.090511 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b98d4954-9e1c-4099-a1e6-b1e343c251d9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:44.098195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b98d4954-9e1c-4099-a1e6-b1e343c251d9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1088 microversion: 2.1 time: 0.076757 Jul 20 19:31:44.099102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 408/810] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:44 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:45.116200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:45.116759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:45.122777 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.123213 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.123962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:45.124423 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:45.189679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:45.197530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f42ae048-13ff-4a65-a8ba-51ee17ab0425 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1138 microversion: 2.1 time: 0.085759 Jul 20 19:31:45.198107 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 403/811] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:45 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:46.219943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:46.221287 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:46.233829 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.234332 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.236309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:46.237299 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:46.318960 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:46.326922 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a04d33f2-cc34-4943-a031-f9be4f932132 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1204 microversion: 2.1 time: 0.115112 Jul 20 19:31:46.328107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 409/812] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:46 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1204 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:47.344008 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:47.344816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:47.351888 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.352371 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.353361 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.353959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.553633 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:47.561310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-94f40aa9-0e86-4f14-ae20-8bebc16e5196 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.221179 Jul 20 19:31:47.561883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 404/813] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:47 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:47.595059 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-11040d91-a68a-4225-bd0e-7aca518b5be2 req-2a060e1e-4ca7-46bc-9d55-292a0ab19373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:47.604172 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-11040d91-a68a-4225-bd0e-7aca518b5be2 req-2a060e1e-4ca7-46bc-9d55-292a0ab19373 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:47.604899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-11040d91-a68a-4225-bd0e-7aca518b5be2 req-2a060e1e-4ca7-46bc-9d55-292a0ab19373 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:47.619403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-11040d91-a68a-4225-bd0e-7aca518b5be2 req-2a060e1e-4ca7-46bc-9d55-292a0ab19373 service nova] Creating event network-changed:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:31:47.625004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-11040d91-a68a-4225-bd0e-7aca518b5be2 req-2a060e1e-4ca7-46bc-9d55-292a0ab19373 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036223 Jul 20 19:31:47.625712 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 410/814] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:48.580935 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:48.581963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:48.589903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.589903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.591187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:48.591187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:48.791142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:48.798502 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9e541428-f6cf-4b19-8a65-9ef8d4583b7e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.223297 Jul 20 19:31:48.799076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 405/815] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:48 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:49.644344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.644939 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.651179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.651625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.652416 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.652944 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.733301 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lazy-loading 'services' on Instance uuid 290d87da-fb62-4dd2-a709-5c033f6b07bd {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:49.803244 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1146e2d2-2d92-4950-b841-d2390a628673 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd/os-volume_attachments/b29fa1d3-ac79-4eb2-b88c-9011733cfffb" status: 202 len: 0 microversion: 2.1 time: 0.163535 Jul 20 19:31:49.803894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 411/816] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:31:49 2022] DELETE /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd/os-volume_attachments/b29fa1d3-ac79-4eb2-b88c-9011733cfffb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:31:49.814820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:49.815968 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:49.822277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.822925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.824086 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:49.824550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:49.962222 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:49.970333 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e71f980a-cc30-4e72-9ae6-89b06590b404 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.158653 Jul 20 19:31:49.970901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 406/817] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:49 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:50.922623 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.923837 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.930001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.930453 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.931219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.931659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.955938 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:31:50.987606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:50.988204 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:50.994756 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.995196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:50.995951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:50.996406 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.038804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-caf1e941-7342-471c-a8f0-0e3c0c389f32 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 204 len: 0 microversion: 2.1 time: 0.120477 Jul 20 19:31:51.039503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 412/818] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:31:50 2022] DELETE /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:31:51.048409 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:51.049075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:51.055178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.055636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.056583 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:51.057020 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:51.132333 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.139801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2afcbc88-0510-45ab-aa0a-c35f891733ac tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.156771 Jul 20 19:31:51.140387 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 407/819] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:50 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:51.187329 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:51.195403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a45e6787-fe86-4b05-8b81-dd45d8615f52 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1512 microversion: 2.1 time: 0.151638 Jul 20 19:31:51.195974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 413/820] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:51 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:52.156742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.157377 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.163879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.164353 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.165118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.165557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.212266 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:52.212884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:52.219356 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.219809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.220629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:52.221071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:52.300942 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.308655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9d6617db-4299-4cc8-8701-288d09e1caa1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.155896 Jul 20 19:31:52.309227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 408/821] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:52.363024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:52.370463 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-05d6a777-7c4d-4fb1-bed0-59e18d1fedac tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1512 microversion: 2.1 time: 0.162089 Jul 20 19:31:52.371027 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 414/822] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:52 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:53.325327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.325939 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.333445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.334997 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.341126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.341582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.384613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-7b735d89-d34d-4bdb-87ee-db7a70d2d838 req-85934dfc-facb-4820-86ef-3d8b04d56b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "290d87da-fb62-4dd2-a709-5c033f6b07bd", "name": "network-vif-deleted", "tag": "5543d4ab-0c29-4d6d-afca-f4861da188ba"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:31:53.393978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-7b735d89-d34d-4bdb-87ee-db7a70d2d838 req-85934dfc-facb-4820-86ef-3d8b04d56b96 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.394489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-7b735d89-d34d-4bdb-87ee-db7a70d2d838 req-85934dfc-facb-4820-86ef-3d8b04d56b96 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.406645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-7b735d89-d34d-4bdb-87ee-db7a70d2d838 req-85934dfc-facb-4820-86ef-3d8b04d56b96 service nova] Creating event network-vif-deleted:5543d4ab-0c29-4d6d-afca-f4861da188ba for instance 290d87da-fb62-4dd2-a709-5c033f6b07bd on hv-cinder-81914 Jul 20 19:31:53.413615 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-7b735d89-d34d-4bdb-87ee-db7a70d2d838 req-85934dfc-facb-4820-86ef-3d8b04d56b96 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 Jul 20 19:31:53.414633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 415/823] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:31:53.420619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:53.421361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:53.430269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.430723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.431483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:53.431915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:53.488889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.496707 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-11d4d256-1c4d-469f-bf1b-f4a230d3e6a3 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.175019 Jul 20 19:31:53.497522 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 409/824] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:53.516227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:53.524506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-197769ba-f9c2-4c9b-8fa3-9577004543b7 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1470 microversion: 2.1 time: 0.108361 Jul 20 19:31:53.525079 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 416/825] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:53 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:54.513251 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.513847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.515668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.516900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.524337 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.524798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.525564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.526000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.540385 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:54.540989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:54.542996 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.549010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.549507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.550303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.550734 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.583213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:54.583670 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:54.584514 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lazy-loading 'fault' on Instance uuid 290d87da-fb62-4dd2-a709-5c033f6b07bd {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:31:54.625092 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.632600 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a9f09032-b318-4f27-81ed-0c035345b288 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 200 len: 1308 microversion: 2.1 time: 0.096117 Jul 20 19:31:54.633098 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 417/826] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:54.660473 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:54.667876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-dcaf083c-7574-416c-88a8-449f1c3bebb1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.158427 Jul 20 19:31:54.668462 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 410/827] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:54 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:55.649420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:55.650001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: 290d87da-fb62-4dd2-a709-5c033f6b07bd] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:55.656568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.657012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.657790 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.658215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.672361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] HTTP exception thrown: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Request method failure captured: Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd HTTP/1.1 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2Ffjz5N-EFu2AKNrt-BO_aUIXoIpvPMw2nrykwIxVT6INPCW3sjYUMGqYp0CVYFbmUzZblakg_0DxZe985VCg5SMbouxMtRtYiw6QFfOGWB98pJ8CS5uxooFKT5utQhJRiW5Ze7hSiRdcCW3O3mRZ_L52Z5AEHyHbsgKirM74_X7vYU Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 7ee2fc4ab6a540cc852d2b3850e6b550 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:31:55.674054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ee2fc4ab6a540cc852d2b3850e6b550"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7ee2fc4ab6a540cc852d2b3850e6b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7ee2fc4ab6a540cc852d2b3850e6b550", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ee2fc4ab6a540cc852d2b3850e6b550"}]}] Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 7ee2fc4ab6a540cc852d2b3850e6b550 Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesSnapshotTestJSON-244268065-project Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 44d26a97291e44c78d3a6438d7ab76c5 Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesSnapshotTestJSON-244268065-project Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. Jul 20 19:31:55.675766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '290d87da-fb62-4dd2-a709-5c033f6b07bd'} Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:31:55.676676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. Jul 20 19:31:55.679761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:31:55.681109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Returning 404 to user: Instance 290d87da-fb62-4dd2-a709-5c033f6b07bd could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:31:55.681109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-85d069f6-c644-44d1-a467-5050ad395d4f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd" status: 404 len: 111 microversion: 2.1 time: 0.030030 Jul 20 19:31:55.681109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 418/828] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:55 2022] GET /compute/v2.1/servers/290d87da-fb62-4dd2-a709-5c033f6b07bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:31:55.684692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:55.685301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:55.693074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.693595 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.694431 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:55.694800 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:55.831111 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:55.841020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-fd45b1a4-b8ce-4d26-85f5-58ca8e74ad9e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.160242 Jul 20 19:31:55.844348 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 411/829] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:55 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:56.858131 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:56.858772 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:56.866013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.866322 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.867085 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:56.867524 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:56.996809 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:57.004189 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-97695777-4cd9-43ba-8331-db04f68755ea tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.149970 Jul 20 19:31:57.004775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 419/830] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:56 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:31:58.022022 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:58.022642 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:58.028803 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.029242 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.030004 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:58.030436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:58.161864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:58.170199 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-607f97c8-c560-4d29-bb3e-851ab34a2ef5 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.152014 Jul 20 19:31:58.170791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 412/831] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:58 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:31:59.187367 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:31:59.187903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:31:59.194720 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.195171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.195940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:31:59.196419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:31:59.331091 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:31:59.339374 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ebbb8414-dd0e-4fcc-a6ac-bf087d6c9f39 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.155861 Jul 20 19:31:59.339954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 420/832] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:31:59 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:00.356600 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:00.357226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:00.363721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.364164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.364954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:00.365394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:00.498706 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:00.506185 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c1043fac-bbed-40e8-b662-eb0d46afca14 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.153487 Jul 20 19:32:00.506749 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 413/833] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:00 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:01.482005 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-9f486aad-941b-4090-a2fe-774eac85ef90 req-10eb30c2-2b04-4334-b09e-86f9a5fa0397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "name": "network-vif-plugged", "status": "completed", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:01.490707 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-9f486aad-941b-4090-a2fe-774eac85ef90 req-10eb30c2-2b04-4334-b09e-86f9a5fa0397 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.491166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-9f486aad-941b-4090-a2fe-774eac85ef90 req-10eb30c2-2b04-4334-b09e-86f9a5fa0397 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.503251 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-9f486aad-941b-4090-a2fe-774eac85ef90 req-10eb30c2-2b04-4334-b09e-86f9a5fa0397 service nova] Creating event network-vif-plugged:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:32:01.508984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-9f486aad-941b-4090-a2fe-774eac85ef90 req-10eb30c2-2b04-4334-b09e-86f9a5fa0397 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030632 Jul 20 19:32:01.509588 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 421/834] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:32:01.524424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:01.525064 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:01.531519 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.531876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.533288 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:01.533434 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:01.668475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:01.676419 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c2d08180-d5c0-41b2-b248-0f4c0fefb700 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.156083 Jul 20 19:32:01.677088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 414/835] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:01 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:02.694613 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:02.695299 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:02.701594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.702041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.702798 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:02.703362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:02.835153 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:02.842667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b968a92f-882b-4446-90e8-7af4bc380468 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.153010 Jul 20 19:32:02.843237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 422/836] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:02 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:03.658637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.659177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.665550 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.665998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.666765 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.667202 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.690459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-15ffdfd7-bc3a-4369-98c4-e71f59d7758f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/ips" status: 200 len: 150 microversion: 2.1 time: 0.036334 Jul 20 19:32:03.691305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 415/837] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:03.860381 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:03.861045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:03.868384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.868931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:03.869918 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:03.870358 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:04.023097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:04.030801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-27399179-5795-4630-b83e-ef37b1af3190 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.174623 Jul 20 19:32:04.031414 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 423/838] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:03 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:05.037929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a82d7be6-7021-4cf3-853f-01ae0022555e"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:05.039027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:05.045596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.046037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.046744 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:05.047196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.047196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.047384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:05.053971 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.054421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.055193 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:05.055635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:05.187645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:05.196205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-64a3807c-a732-470a-8550-cfb402a32e3b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1260 microversion: 2.1 time: 0.153207 Jul 20 19:32:05.196796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 424/839] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:05 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:05.331434 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-294fedae-0031-451e-8dd9-71aa5efbd29c tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297176 Jul 20 19:32:05.332050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 416/840] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:32:05 2022] POST /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:05.565496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-601438496", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "networks": [{"uuid": "dfc282ec-1eef-40ce-8830-4e9b4223e710"}]}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:05.615030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] validate_networks() for [('dfc282ec-1eef-40ce-8830-4e9b4223e710', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:32:06.210377 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:32:06.210917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:32:06.211257 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:32:06.211661 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:32:06.212072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:32:06.214645 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.215348 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:06.221819 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.222031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.222270 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.222384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.223080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.223259 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.223486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.223633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.240881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Getting quotas for project 7ee2fc4ab6a540cc852d2b3850e6b550. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:32:06.244981 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Getting quotas for user 44d26a97291e44c78d3a6438d7ab76c5 and project 7ee2fc4ab6a540cc852d2b3850e6b550. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:32:06.257300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:32:06.259592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:32:06.306430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-02b8bd28-f888-4d42-8929-9ca7a9d77baa tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745315 Jul 20 19:32:06.307282 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 425/841] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 19:32:06.324517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3c7f4734-16f7-4871-b240-8af7f3ed7e5b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.325320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3c7f4734-16f7-4871-b240-8af7f3ed7e5b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:06.398065 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.417108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-94f303d4-ba17-4819-bf65-02ba4025cc30 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1444 microversion: 2.1 time: 0.206859 Jul 20 19:32:06.418264 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 417/842] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:06.423601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3c7f4734-16f7-4871-b240-8af7f3ed7e5b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.437007 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3c7f4734-16f7-4871-b240-8af7f3ed7e5b tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1218 microversion: 2.1 time: 0.116808 Jul 20 19:32:06.438721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 426/843] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:06.448426 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:06.448426 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:06.452577 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.453148 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.454212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:06.454753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:06.461855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:06.634836 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:06.643592 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f7d3e4e0-0945-458a-8f51-2ef9058e1407 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1444 microversion: 2.1 time: 0.210009 Jul 20 19:32:06.644372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 418/844] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:06 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1444 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:07.455308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:07.455916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:07.462755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.463199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.464008 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:07.464498 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:07.468957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:07.538219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:07.546943 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-93af3b95-a1c2-4304-aa11-08cc2544b1bf tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1270 microversion: 2.1 time: 0.095551 Jul 20 19:32:07.553763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 427/845] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:07 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:08.563665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:08.565027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:08.572424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.572874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.573862 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:08.574293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:08.699016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:08.706948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ac03eecf-a76d-46ac-ba31-3038cbb12b7a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1276 microversion: 2.1 time: 0.146958 Jul 20 19:32:08.707541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 419/846] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:08 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:09.540241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-978c32ca-813d-434c-b19f-b3d0ff3ed989 req-e84cd6e4-a030-4320-a7b7-a978dae38a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:09.549986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-978c32ca-813d-434c-b19f-b3d0ff3ed989 req-e84cd6e4-a030-4320-a7b7-a978dae38a55 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.550919 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-978c32ca-813d-434c-b19f-b3d0ff3ed989 req-e84cd6e4-a030-4320-a7b7-a978dae38a55 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.562917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-978c32ca-813d-434c-b19f-b3d0ff3ed989 req-e84cd6e4-a030-4320-a7b7-a978dae38a55 service nova] Creating event network-changed:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:32:09.569371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-978c32ca-813d-434c-b19f-b3d0ff3ed989 req-e84cd6e4-a030-4320-a7b7-a978dae38a55 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033198 Jul 20 19:32:09.570420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 428/847] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:09.725351 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:09.726588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:09.733499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.734201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:09.734992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:09.735424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:10.201273 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:10.209340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c19f32a4-f5cf-4af8-b83d-cc6cb42d353c tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.487678 Jul 20 19:32:10.209910 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 420/848] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:09 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:11.227348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:11.228027 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:11.235017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.235643 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.236439 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.236879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.367665 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:11.375178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b74e6701-1e4f-40f0-a97c-ac9cc836de59 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.152061 Jul 20 19:32:11.375743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 429/849] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:11 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:11.588592 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-047be911-8b6a-47be-a63c-d33f67b65016 req-2e924df4-a044-403a-8851-e5a12fe89571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d82d6a76-f906-4501-b937-314df918f1fa", "tag": "62c457e3-6560-49ca-9640-12ed55390246"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:11.597553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-047be911-8b6a-47be-a63c-d33f67b65016 req-2e924df4-a044-403a-8851-e5a12fe89571 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:11.597998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-047be911-8b6a-47be-a63c-d33f67b65016 req-2e924df4-a044-403a-8851-e5a12fe89571 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:11.608668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-047be911-8b6a-47be-a63c-d33f67b65016 req-2e924df4-a044-403a-8851-e5a12fe89571 service nova] Creating event network-changed:62c457e3-6560-49ca-9640-12ed55390246 for instance d82d6a76-f906-4501-b937-314df918f1fa on hv-cinder-81914 Jul 20 19:32:11.615209 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-047be911-8b6a-47be-a63c-d33f67b65016 req-2e924df4-a044-403a-8851-e5a12fe89571 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031186 Jul 20 19:32:11.616158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 421/850] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:12.391308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:12.392599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:12.399629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.400077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.400867 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:12.401303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:12.536687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:12.544748 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-40aabef6-01cf-429a-b641-ab10284327e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.157560 Jul 20 19:32:12.545503 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 430/851] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:12 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:12.907143 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-42b6416b-4b4a-4d96-98e0-81c630735fa7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: .version_select at 0x7f26c1463940>, body: {"keypair": {"name": "tempest-keypair-1700621114", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCD+8e9dUzcNRroVKpK86+0hwLjC39FvbcRIl+7F1+zcD7GrXVM4hz5kS9o1udRJwwjaP2oAZfEwLLuLpqnT5/Mq+dZ5il6B5qgYiV3pC8Azm2vQAtvnBdoJybKnyaF3eA=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:12.921781 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-42b6416b-4b4a-4d96-98e0-81c630735fa7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:32:12.926130 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-42b6416b-4b4a-4d96-98e0-81c630735fa7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:32:12.949276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-42b6416b-4b4a-4d96-98e0-81c630735fa7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046145 Jul 20 19:32:12.949889 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 422/852] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:32:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:13.561837 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:13.562758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:13.570779 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.571236 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.572097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:13.572618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:13.859350 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:13.868109 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fe437e6e-fef9-42fa-9dc1-dfe7e1a0825e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.310265 Jul 20 19:32:13.877111 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 431/853] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:13 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:14.268530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1907946977", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1f9468-ee30-4ff5-9d99-0240a7903291"}], "security_groups": [{"name": "tempest-securitygroup--1363229604"}], "key_name": "tempest-keypair-1700621114", "user_data": "}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:14.275584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.374041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] validate_networks() for [('8d1f9468-ee30-4ff5-9d99-0240a7903291', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:32:14.742705 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:32:14.743129 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:32:14.743597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:32:14.744037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:32:14.744494 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:32:14.754061 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.754502 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.755285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.755712 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.772983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:32:14.776894 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:32:14.787579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:32:14.789961 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:32:14.837231 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-b58dcc6d-8e23-4e55-bee9-85505082f713 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574178 Jul 20 19:32:14.837959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 423/854] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:32:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:32:14.847952 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-88cd4297-bdde-411f-adf5-a579353a1998 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.848695 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-88cd4297-bdde-411f-adf5-a579353a1998 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.851068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.885139 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:14.886049 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:14.894050 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.894421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.895193 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:14.895848 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:14.908322 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-88cd4297-bdde-411f-adf5-a579353a1998 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:14.915166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-88cd4297-bdde-411f-adf5-a579353a1998 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1242 microversion: 2.1 time: 0.071033 Jul 20 19:32:14.915835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 432/855] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:15.037190 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:15.044885 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-74de54a1-b4e7-4a82-976b-07339111271d tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.163575 Jul 20 19:32:15.051586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 424/856] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:14 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:15.546652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-145cfcc6-f70b-4eae-848d-f72be7b2bd47 req-db6c75f0-fcb0-4f6d-bd03-dc3dec66833a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82d6a76-f906-4501-b937-314df918f1fa", "name": "network-vif-plugged", "status": "completed", "tag": "62c457e3-6560-49ca-9640-12ed55390246"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:15.556470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-145cfcc6-f70b-4eae-848d-f72be7b2bd47 req-db6c75f0-fcb0-4f6d-bd03-dc3dec66833a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.556954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-145cfcc6-f70b-4eae-848d-f72be7b2bd47 req-db6c75f0-fcb0-4f6d-bd03-dc3dec66833a service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.569743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-145cfcc6-f70b-4eae-848d-f72be7b2bd47 req-db6c75f0-fcb0-4f6d-bd03-dc3dec66833a service nova] Creating event network-vif-plugged:62c457e3-6560-49ca-9640-12ed55390246 for instance d82d6a76-f906-4501-b937-314df918f1fa on hv-cinder-81914 Jul 20 19:32:15.575429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-145cfcc6-f70b-4eae-848d-f72be7b2bd47 req-db6c75f0-fcb0-4f6d-bd03-dc3dec66833a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Jul 20 19:32:15.576083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 433/857] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:15.932810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:15.933417 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:15.940562 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.941281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:15.942044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:15.942477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.002988 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.010282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e7e89571-3461-44fb-a0ef-c0487c35b0d4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1300 microversion: 2.1 time: 0.081345 Jul 20 19:32:16.010850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 425/858] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:15 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:16.062759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:16.063501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:16.071015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.071469 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.072228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:16.072699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:16.205924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:16.213681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2630fb08-2435-43e9-8eb2-dc9dd252e6dc tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1318 microversion: 2.1 time: 0.155090 Jul 20 19:32:16.214457 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 434/859] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:16 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:17.026983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.027523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.034847 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.035297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.036077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.036721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.230192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:17.230796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.233043 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:17.240948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.241404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.242185 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.242609 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.257794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.268343 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2bb8a85e-80c4-400d-a28e-14f2b34913ab tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.245152 Jul 20 19:32:17.269040 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 426/860] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:17.386743 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:17.394656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-531ffef2-9d87-4a16-b466-269c51d7f8da tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1507 microversion: 2.1 time: 0.168482 Jul 20 19:32:17.395218 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 435/861] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:17 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:32:17.412133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7edb0026-cc21-4629-a45c-f5b070f1e389", "device": "/dev/sdb"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:17.413784 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:17.420257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.420688 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.421583 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.422026 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.451010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-64d20114-38a5-49c0-94f9-6ced3f3ffeed req-299df80a-cdc4-42f9-a75b-cc9303842657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb62e6d-0304-4ea4-99cd-d08cfaef4834", "tag": "e7fe02cf-3cdb-4054-82e9-d944964153e3"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:17.467206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-64d20114-38a5-49c0-94f9-6ced3f3ffeed req-299df80a-cdc4-42f9-a75b-cc9303842657 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:17.467726 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-64d20114-38a5-49c0-94f9-6ced3f3ffeed req-299df80a-cdc4-42f9-a75b-cc9303842657 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:17.480042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-64d20114-38a5-49c0-94f9-6ced3f3ffeed req-299df80a-cdc4-42f9-a75b-cc9303842657 service nova] Creating event network-changed:e7fe02cf-3cdb-4054-82e9-d944964153e3 for instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 on hv-cinder-81914 Jul 20 19:32:17.485091 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-64d20114-38a5-49c0-94f9-6ced3f3ffeed req-299df80a-cdc4-42f9-a75b-cc9303842657 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040150 Jul 20 19:32:17.486316 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 436/862] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:17.726897 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ee740d54-ba0b-406d-ba2e-4f917533236f tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "POST /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319026 Jul 20 19:32:17.731802 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 427/863] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:32:17 2022] POST /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:18.286422 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:18.287115 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:18.293389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.293839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.294607 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:18.295044 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:18.422912 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:18.430850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a9056165-262f-4c30-abbf-783f240f4e14 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.149086 Jul 20 19:32:18.431419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 437/864] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:18 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:19.449142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:19.449855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:19.456902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.457344 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.458094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:19.458523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:19.591236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:19.599152 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-82a17e39-e4e3-4dfd-8cce-e8bce7b95e74 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.154924 Jul 20 19:32:19.599704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 428/865] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:19 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:20.616581 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:20.617340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:20.624333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.624789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.625562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:20.626000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:20.759508 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:20.766857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d88a26cd-3d64-41b5-a072-07edbd600623 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.154755 Jul 20 19:32:20.767415 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 438/866] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:20 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:21.783760 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:21.784451 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:21.790857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.791299 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.792051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:21.792529 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:21.918998 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:21.927257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a2bb7efc-0e8b-4721-b4e8-7000643e6bbf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.147431 Jul 20 19:32:21.927830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 429/867] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:21 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:22.943815 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:22.944465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:22.950693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.951139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:22.951892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:22.952351 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.082689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:23.089966 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d76496bc-4d71-4a92-993e-aa9dac3bf7a9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.150317 Jul 20 19:32:23.090526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 439/868] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:22 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:23.573724 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-acebb415-f4ab-4be5-a606-3d93668b2470 req-4ac42f98-0976-4d6a-8ebc-d7669ba8bb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb62e6d-0304-4ea4-99cd-d08cfaef4834", "name": "network-vif-plugged", "status": "completed", "tag": "e7fe02cf-3cdb-4054-82e9-d944964153e3"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:23.582951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-acebb415-f4ab-4be5-a606-3d93668b2470 req-4ac42f98-0976-4d6a-8ebc-d7669ba8bb05 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:23.583401 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-acebb415-f4ab-4be5-a606-3d93668b2470 req-4ac42f98-0976-4d6a-8ebc-d7669ba8bb05 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:23.594528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-acebb415-f4ab-4be5-a606-3d93668b2470 req-4ac42f98-0976-4d6a-8ebc-d7669ba8bb05 service nova] Creating event network-vif-plugged:e7fe02cf-3cdb-4054-82e9-d944964153e3 for instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 on hv-cinder-81914 Jul 20 19:32:23.600085 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-acebb415-f4ab-4be5-a606-3d93668b2470 req-4ac42f98-0976-4d6a-8ebc-d7669ba8bb05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030188 Jul 20 19:32:23.600940 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 430/869] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:24.106773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:24.107376 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:24.114032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.114478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.115256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:24.115690 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:24.249489 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:24.257704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-12a0c17e-93eb-498e-8921-e48491a8d525 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.154681 Jul 20 19:32:24.258281 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 440/870] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:24 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:25.273031 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:25.273877 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=10 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:25.278274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:25.278962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:25.286669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.287107 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.287901 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:25.288357 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:25.429126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:25.437721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d94efd93-49de-4dea-baeb-b9a0ed22e1cd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1368 microversion: 2.1 time: 0.166175 Jul 20 19:32:25.438307 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 431/871] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:25 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:26.456086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:26.456721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:26.458616 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=10 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:26.465011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.465455 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.466232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.466663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.615178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:26.623662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4026d066-1de4-40a1-b267-95a8d0ed5262 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1558 microversion: 2.1 time: 0.171472 Jul 20 19:32:26.624243 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 441/872] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:26 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:26.640271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:26.641077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:26.648386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.648834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.649890 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:26.650318 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:26.881098 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2f27a49e-aaeb-4810-b638-74cde97418d9 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245081 Jul 20 19:32:26.881703 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 432/873] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:32:26 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:28.110766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-564d268b-08cf-4466-a362-0a9de593998b req-e2cc5447-d378-496d-b852-ec265876824f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb62e6d-0304-4ea4-99cd-d08cfaef4834", "tag": "e7fe02cf-3cdb-4054-82e9-d944964153e3"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:28.120867 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-564d268b-08cf-4466-a362-0a9de593998b req-e2cc5447-d378-496d-b852-ec265876824f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:28.121339 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-564d268b-08cf-4466-a362-0a9de593998b req-e2cc5447-d378-496d-b852-ec265876824f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:28.134392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-564d268b-08cf-4466-a362-0a9de593998b req-e2cc5447-d378-496d-b852-ec265876824f service nova] Creating event network-changed:e7fe02cf-3cdb-4054-82e9-d944964153e3 for instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 on hv-cinder-81914 Jul 20 19:32:28.139566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-564d268b-08cf-4466-a362-0a9de593998b req-e2cc5447-d378-496d-b852-ec265876824f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032306 Jul 20 19:32:28.140163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 442/874] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:39.166644 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:39.167232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:39.169729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:39.170373 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:39.177690 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.178220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.179126 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:39.179643 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:39.267348 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lazy-loading 'services' on Instance uuid d82d6a76-f906-4501-b937-314df918f1fa {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:32:39.354021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-77a89046-2e3d-401e-a79e-a0784fa0b3e3 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa/os-volume_attachments/7edb0026-cc21-4629-a45c-f5b070f1e389" status: 202 len: 0 microversion: 2.1 time: 0.191096 Jul 20 19:32:39.354654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 433/875] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:32:39 2022] DELETE /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa/os-volume_attachments/7edb0026-cc21-4629-a45c-f5b070f1e389 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:32:40.471001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=23 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:40.471735 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=72 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:40.475926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:40.476539 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:40.483389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.483842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.484640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.485080 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.509423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:32:40.586190 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e83ef341-2118-457f-99ec-b40a6ac3320e tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 204 len: 0 microversion: 2.1 time: 0.116386 Jul 20 19:32:40.586919 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 443/876] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:32:40 2022] DELETE /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:32:40.596232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:40.596953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:40.603191 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.603579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.604354 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:40.604790 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:40.732276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:40.739848 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-da3f8161-df92-44de-8392-8f66d4b62aed tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1513 microversion: 2.1 time: 0.148262 Jul 20 19:32:40.740437 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 434/877] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:40 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:41.757446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:41.758063 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:41.764878 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.765333 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.766113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:41.766554 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:41.899043 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:41.906444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e83be75c-e3c4-4e02-aeb7-9678e2af5bdd tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1513 microversion: 2.1 time: 0.153376 Jul 20 19:32:41.907168 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 444/878] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:41 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:42.897804 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-abf275cd-ad37-4429-a8b4-bfbab13c8706 req-cd1efe29-aa1f-411c-af62-721fdb7161ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d82d6a76-f906-4501-b937-314df918f1fa", "name": "network-vif-deleted", "tag": "62c457e3-6560-49ca-9640-12ed55390246"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:32:42.906261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-abf275cd-ad37-4429-a8b4-bfbab13c8706 req-cd1efe29-aa1f-411c-af62-721fdb7161ed service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.906711 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-abf275cd-ad37-4429-a8b4-bfbab13c8706 req-cd1efe29-aa1f-411c-af62-721fdb7161ed service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.918945 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-abf275cd-ad37-4429-a8b4-bfbab13c8706 req-cd1efe29-aa1f-411c-af62-721fdb7161ed service nova] Creating event network-vif-deleted:62c457e3-6560-49ca-9640-12ed55390246 for instance d82d6a76-f906-4501-b937-314df918f1fa on hv-cinder-81914 Jul 20 19:32:42.924047 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-abf275cd-ad37-4429-a8b4-bfbab13c8706 req-cd1efe29-aa1f-411c-af62-721fdb7161ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Jul 20 19:32:42.925341 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 435/879] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:32:42.925847 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:42.927106 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:42.935122 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.935577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:42.936373 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:42.936838 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:43.010093 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d26a97291e44c78d3a6438d7ab76c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee2fc4ab6a540cc852d2b3850e6b550', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:32:43.019601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-c186826b-74ce-451e-99a6-67018174b08a tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 200 len: 1303 microversion: 2.1 time: 0.100411 Jul 20 19:32:43.020183 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 445/880] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:42 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:32:44.037048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:32:44.037744 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] [instance: d82d6a76-f906-4501-b937-314df918f1fa] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:32:44.043856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.044328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.045095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:32:44.045538 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:32:44.059027 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] HTTP exception thrown: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Request method failure captured: Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa HTTP/1.1 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2Ffjz5N-EFu2AKNrt-BO_aUIXoIpvPMw2nrykwIxVT6INPCW3sjYUMGqYp0CVYFbmUzZblakg_0DxZe985VCg5SMbouxMtRtYiw6QFfOGWB98pJ8CS5uxooFKT5utQhJRiW5Ze7hSiRdcCW3O3mRZ_L52Z5AEHyHbsgKirM74_X7vYU Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 7ee2fc4ab6a540cc852d2b3850e6b550 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:32:44.060658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ee2fc4ab6a540cc852d2b3850e6b550"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7ee2fc4ab6a540cc852d2b3850e6b550"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7ee2fc4ab6a540cc852d2b3850e6b550", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7ee2fc4ab6a540cc852d2b3850e6b550"}]}] Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 7ee2fc4ab6a540cc852d2b3850e6b550 Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-244268065 Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-VolumesSnapshotTestJSON-244268065-project Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 44d26a97291e44c78d3a6438d7ab76c5 Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-VolumesSnapshotTestJSON-244268065-project Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. Jul 20 19:32:44.062301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'd82d6a76-f906-4501-b937-314df918f1fa'} Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:32:44.063293 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. Jul 20 19:32:44.064639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:32:44.066757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] Returning 404 to user: Instance d82d6a76-f906-4501-b937-314df918f1fa could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:32:44.066757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0fd6f810-a811-4b45-b40a-c69eb45a8625 tempest-VolumesSnapshotTestJSON-244268065 tempest-VolumesSnapshotTestJSON-244268065-project] 10.222.0.43 "GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa" status: 404 len: 111 microversion: 2.1 time: 0.030336 Jul 20 19:32:44.066757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 436/881] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:32:44 2022] GET /compute/v2.1/servers/d82d6a76-f906-4501-b937-314df918f1fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:05.589239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.590118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.591965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-15dc9ee8-d182-4d6d-89b1-2ab8b4742e3b req-610abca3-560c-4694-8d84-2468cafba414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7319e9f1-695b-4f3a-a3ea-a2a07532bce6", "tag": "d2fa33bc-fe23-49d5-b13a-86ff922d5120"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:05.592471 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.593311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.598160 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=8 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.598941 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:05.599101 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.599651 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.600820 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.601314 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.604103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-15dc9ee8-d182-4d6d-89b1-2ab8b4742e3b req-610abca3-560c-4694-8d84-2468cafba414 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.604825 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-15dc9ee8-d182-4d6d-89b1-2ab8b4742e3b req-610abca3-560c-4694-8d84-2468cafba414 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.618559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-15dc9ee8-d182-4d6d-89b1-2ab8b4742e3b req-610abca3-560c-4694-8d84-2468cafba414 service nova] Creating event network-changed:d2fa33bc-fe23-49d5-b13a-86ff922d5120 for instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 on hv-cinder-81914 Jul 20 19:33:05.626448 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-15dc9ee8-d182-4d6d-89b1-2ab8b4742e3b req-610abca3-560c-4694-8d84-2468cafba414 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038618 Jul 20 19:33:05.627302 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 437/882] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:05.634664 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:05.731622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a0f2d15f-efe7-460f-8d1e-0a7c8a3c2113 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 204 len: 0 microversion: 2.1 time: 0.145946 Jul 20 19:33:05.732637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 446/883] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:05 2022] DELETE /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:05.741207 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:05.742606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:05.749312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.749832 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.750671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:05.751323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:05.922684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:05.930621 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e2a57f6e-8bf4-42bd-94f7-d693abdf3545 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1577 microversion: 2.1 time: 0.193655 Jul 20 19:33:05.931196 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 438/884] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:05 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:06.949000 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:06.949625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:06.956573 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.957017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:06.957803 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:06.958233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:07.112246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:07.119781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-91131fff-4d6d-4af7-83b6-5a4520d05388 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1577 microversion: 2.1 time: 0.175197 Jul 20 19:33:07.120369 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 447/885] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:06 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:08.138358 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:08.139657 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:08.147346 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.148048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.148856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.149284 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.237913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:08.249609 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-be52b795-2875-4d17-a2b7-450edc7e9dfa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 200 len: 1391 microversion: 2.1 time: 0.115420 Jul 20 19:33:08.249810 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-88a5d303-a073-4da8-8101-9c23b12658d9 req-a865e810-c333-440b-91a0-1f6c4a1f0cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7319e9f1-695b-4f3a-a3ea-a2a07532bce6", "name": "network-vif-deleted", "tag": "d2fa33bc-fe23-49d5-b13a-86ff922d5120"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:08.252613 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 439/886] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:08 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 1391 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:08.264889 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-88a5d303-a073-4da8-8101-9c23b12658d9 req-a865e810-c333-440b-91a0-1f6c4a1f0cb6 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:08.274531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-88a5d303-a073-4da8-8101-9c23b12658d9 req-a865e810-c333-440b-91a0-1f6c4a1f0cb6 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:08.291981 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-88a5d303-a073-4da8-8101-9c23b12658d9 req-a865e810-c333-440b-91a0-1f6c4a1f0cb6 service nova] Creating event network-vif-deleted:d2fa33bc-fe23-49d5-b13a-86ff922d5120 for instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 on hv-cinder-81914 Jul 20 19:33:08.299968 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-88a5d303-a073-4da8-8101-9c23b12658d9 req-a865e810-c333-440b-91a0-1f6c4a1f0cb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053543 Jul 20 19:33:08.301035 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 448/887] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:09.274056 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:09.274576 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: 7319e9f1-695b-4f3a-a3ea-a2a07532bce6] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:09.280979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.281422 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.282181 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:09.282614 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:09.296448 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] HTTP exception thrown: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Request method failure captured: Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 HTTP/1.1 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FaPCzCXhCDK1_HmAuSuXMqDalt2BiGEihr9CJS15YHUk9MXLyI5FChMo7oi-ILdk_sWZP2A74imqUA67y1RZKBOx4t5AFBfIiC7gLLpk_lMhspkor7qAQ7elwItpniLljdURUoJvWid3aS7kjdlZJw_clQ9HBMaxcLODo2r9AJJBRE Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:33:09.298114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_182d5b6ac9e6412b907119a623869c80", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}] Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 4a4f4d585adf40b880be44c29ecd53cd Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. Jul 20 19:33:09.300661 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '7319e9f1-695b-4f3a-a3ea-a2a07532bce6'} Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:09.301680 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. Jul 20 19:33:09.303223 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:09.304697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Returning 404 to user: Instance 7319e9f1-695b-4f3a-a3ea-a2a07532bce6 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:09.304697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a032a42b-f757-4c3d-a3a5-9aa3afbda21f tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6" status: 404 len: 111 microversion: 2.1 time: 0.029444 Jul 20 19:33:09.304697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 440/888] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:09 2022] GET /compute/v2.1/servers/7319e9f1-695b-4f3a-a3ea-a2a07532bce6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:33:12.371582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.372157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.372471 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-f31b28fb-db06-4e1f-9e7a-d7853ceaac21 req-0fa3558f-2716-4283-bc24-203d3bdc26b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da0908d1-fce4-4940-abd9-c6ea2ca59582", "tag": "d4258cc8-3ff2-4715-a57c-63a1ef623811"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:12.379315 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.379937 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.380540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.381038 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-f31b28fb-db06-4e1f-9e7a-d7853ceaac21 req-0fa3558f-2716-4283-bc24-203d3bdc26b8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.381397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.381589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-f31b28fb-db06-4e1f-9e7a-d7853ceaac21 req-0fa3558f-2716-4283-bc24-203d3bdc26b8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.394463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-f31b28fb-db06-4e1f-9e7a-d7853ceaac21 req-0fa3558f-2716-4283-bc24-203d3bdc26b8 service nova] Creating event network-changed:d4258cc8-3ff2-4715-a57c-63a1ef623811 for instance da0908d1-fce4-4940-abd9-c6ea2ca59582 on hv-cinder-81914 Jul 20 19:33:12.399686 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-f31b28fb-db06-4e1f-9e7a-d7853ceaac21 req-0fa3558f-2716-4283-bc24-203d3bdc26b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030746 Jul 20 19:33:12.400675 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 441/889] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:12.413788 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:12.509361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a789c176-19b0-48e5-90ef-04f6c6ae9408 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 204 len: 0 microversion: 2.1 time: 0.141685 Jul 20 19:33:12.513599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 449/890] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:12 2022] DELETE /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 19:33:12.520951 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:12.521649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:12.528322 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.528996 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.530095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:12.530215 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:12.677374 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:12.685195 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bbd016eb-5d57-4c53-8424-9539e1832e68 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1580 microversion: 2.1 time: 0.169744 Jul 20 19:33:12.685767 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 442/891] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:12 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1580 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:13.703785 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:13.704654 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:13.711641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.712096 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.712984 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:13.713435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:13.881757 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:13.890001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dfe59236-509a-45ce-b6fc-75924ebebd35 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1580 microversion: 2.1 time: 0.190609 Jul 20 19:33:13.890801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 450/892] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:13 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1580 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:14.679975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-1dd260be-f4d2-4127-bff2-bb20d59e9af9 req-7cfeb910-42e5-421a-80df-d409217c4c79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da0908d1-fce4-4940-abd9-c6ea2ca59582", "name": "network-vif-deleted", "tag": "d4258cc8-3ff2-4715-a57c-63a1ef623811"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:14.688466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1dd260be-f4d2-4127-bff2-bb20d59e9af9 req-7cfeb910-42e5-421a-80df-d409217c4c79 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.688924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1dd260be-f4d2-4127-bff2-bb20d59e9af9 req-7cfeb910-42e5-421a-80df-d409217c4c79 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.701092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-1dd260be-f4d2-4127-bff2-bb20d59e9af9 req-7cfeb910-42e5-421a-80df-d409217c4c79 service nova] Creating event network-vif-deleted:d4258cc8-3ff2-4715-a57c-63a1ef623811 for instance da0908d1-fce4-4940-abd9-c6ea2ca59582 on hv-cinder-81914 Jul 20 19:33:14.706305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-1dd260be-f4d2-4127-bff2-bb20d59e9af9 req-7cfeb910-42e5-421a-80df-d409217c4c79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 Jul 20 19:33:14.706990 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 443/893] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:14.867518 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:14.868116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.874629 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.874999 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.875848 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.876306 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.901168 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-12e15781-853a-498e-a753-e33433c9cc42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/ips" status: 200 len: 150 microversion: 2.1 time: 0.037302 Jul 20 19:33:14.906711 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 451/894] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:33:14 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:14.908072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:14.909545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.913423 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a82d7be6-7021-4cf3-853f-01ae0022555e"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:14.914495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:14.916035 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.916983 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.918025 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.918629 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.920906 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.921487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:14.922271 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:14.922711 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.000640 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.009254 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-557c749f-065f-425e-87f0-f5615859c7c4 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1226 microversion: 2.1 time: 0.105731 Jul 20 19:33:15.018171 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 444/895] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:14 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:15.027786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: POST /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/os-volume_attachments HTTP/1.1 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 74 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:33:15.029558 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {"volumeAttachment": {"volumeId": "a82d7be6-7021-4cf3-853f-01ae0022555e"}} Jul 20 19:33:15.031237 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'server_id': 'feb62e6d-0304-4ea4-99cd-d08cfaef4834', 'body': {'volumeAttachment': {'volumeId': 'a82d7be6-7021-4cf3-853f-01ae0022555e'}}} Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:15.032192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:15.035086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 400 to user: Invalid volume: volume a82d7be6-7021-4cf3-853f-01ae0022555e is already attached to instances: e4c7e031-3c69-4679-bc2b-2e144ec5952e {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a4bdcff5-552c-450b-9872-8bf4a38d04bd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122437 Jul 20 19:33:15.036800 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 452/896] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:33:14 2022] POST /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 19:33:15.046256 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.046886 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.053960 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.054424 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.055224 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.055658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.082292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:15.168672 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-05df9236-312b-47b2-b6b6-40629208a49a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 204 len: 0 microversion: 2.1 time: 0.126889 Jul 20 19:33:15.169280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 445/897] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:15 2022] DELETE /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:15.178182 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:15.178808 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:15.185587 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.186038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.186992 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:15.187239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:15.331388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:15.340078 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-07467779-c9e9-499d-9d8b-be40cc035e9d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1683 microversion: 2.1 time: 0.166287 Jul 20 19:33:15.340681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 453/898] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:15 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:16.026959 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.027668 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.034285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.034725 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.035479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.035909 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.070283 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.070722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.071155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lazy-loading 'fault' on Instance uuid da0908d1-fce4-4940-abd9-c6ea2ca59582 {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:16.118163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a4f4d585adf40b880be44c29ecd53cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182d5b6ac9e6412b907119a623869c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.130974 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-45a72f9e-9307-4e6d-82d7-07419e1b24d5 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 200 len: 1231 microversion: 2.1 time: 0.108150 Jul 20 19:33:16.131559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 446/899] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 1231 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:16.358271 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:16.358875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:16.366170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.366622 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.367414 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:16.367876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:16.504548 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:16.512065 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-07bea5d4-f592-41e8-8028-9ed7741733c1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1683 microversion: 2.1 time: 0.157819 Jul 20 19:33:16.512681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 454/900] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:16 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:17.148882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.149491 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: da0908d1-fce4-4940-abd9-c6ea2ca59582] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.155866 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.156323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.157087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.157516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.171073 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] HTTP exception thrown: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Request method failure captured: Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 HTTP/1.1 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FaPCzCXhCDK1_HmAuSuXMqDalt2BiGEihr9CJS15YHUk9MXLyI5FChMo7oi-ILdk_sWZP2A74imqUA67y1RZKBOx4t5AFBfIiC7gLLpk_lMhspkor7qAQ7elwItpniLljdURUoJvWid3aS7kjdlZJw_clQ9HBMaxcLODo2r9AJJBRE Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:33:17.173001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_182d5b6ac9e6412b907119a623869c80", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}] Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 4a4f4d585adf40b880be44c29ecd53cd Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. Jul 20 19:33:17.174617 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'da0908d1-fce4-4940-abd9-c6ea2ca59582'} Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:17.175559 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. Jul 20 19:33:17.177075 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.178511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Returning 404 to user: Instance da0908d1-fce4-4940-abd9-c6ea2ca59582 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:17.178511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9932619e-74bb-4fa6-ada5-5ac5dd475036 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582" status: 404 len: 111 microversion: 2.1 time: 0.029784 Jul 20 19:33:17.178511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 447/901] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:17 2022] GET /compute/v2.1/servers/da0908d1-fce4-4940-abd9-c6ea2ca59582 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:17.529570 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.530284 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.538504 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.539771 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.540901 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.541585 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.650245 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:17.657890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0653ea32-dd09-4a2b-a86a-94cf8c662aa0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 200 len: 1615 microversion: 2.1 time: 0.132616 Jul 20 19:33:17.659089 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 455/902] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:17 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 1615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:17.677034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.677463 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.684097 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.684599 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.685369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.685806 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.700232 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] HTTP exception thrown: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Request method failure captured: Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f HTTP/1.1 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FaPCzCXhCDK1_HmAuSuXMqDalt2BiGEihr9CJS15YHUk9MXLyI5FChMo7oi-ILdk_sWZP2A74imqUA67y1RZKBOx4t5AFBfIiC7gLLpk_lMhspkor7qAQ7elwItpniLljdURUoJvWid3aS7kjdlZJw_clQ9HBMaxcLODo2r9AJJBRE Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:33:17.701838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_182d5b6ac9e6412b907119a623869c80", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}] Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 4a4f4d585adf40b880be44c29ecd53cd Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.703482 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'd469a829-8282-4106-a0d6-4197710acf5f'} Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:17.704700 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.706794 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.708719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Returning 404 to user: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:17.708719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-621b1d05-32a9-434a-aad7-b36009b694a6 tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 404 len: 111 microversion: 2.1 time: 0.030740 Jul 20 19:33:17.708719 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 448/903] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:17 2022] DELETE /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:17.712448 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:17.713068 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] [instance: d469a829-8282-4106-a0d6-4197710acf5f] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:17.719300 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.719749 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.720562 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.721619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.736411 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] HTTP exception thrown: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Request method failure captured: Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f HTTP/1.1 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FaPCzCXhCDK1_HmAuSuXMqDalt2BiGEihr9CJS15YHUk9MXLyI5FChMo7oi-ILdk_sWZP2A74imqUA67y1RZKBOx4t5AFBfIiC7gLLpk_lMhspkor7qAQ7elwItpniLljdURUoJvWid3aS7kjdlZJw_clQ9HBMaxcLODo2r9AJJBRE Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:33:17.738014 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/182d5b6ac9e6412b907119a623869c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_182d5b6ac9e6412b907119a623869c80", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/182d5b6ac9e6412b907119a623869c80"}]}] Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 182d5b6ac9e6412b907119a623869c80 Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-TestVolumeBootPattern-1389076127 Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 4a4f4d585adf40b880be44c29ecd53cd Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-TestVolumeBootPattern-1389076127-project Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.739384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'd469a829-8282-4106-a0d6-4197710acf5f'} Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:17.740165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. Jul 20 19:33:17.741419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:17.742510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Returning 404 to user: Instance d469a829-8282-4106-a0d6-4197710acf5f could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:17.742510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1b4bdd20-7b29-498d-a84b-2819baaf1afa tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f" status: 404 len: 111 microversion: 2.1 time: 0.030820 Jul 20 19:33:17.742510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 456/904] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:17 2022] GET /compute/v2.1/servers/d469a829-8282-4106-a0d6-4197710acf5f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:17.777123 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-ae0f0365-91fa-421d-abc4-3247b616aeca req-a9a22fdd-ef1e-40d2-a4c0-201901355997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb62e6d-0304-4ea4-99cd-d08cfaef4834", "name": "network-vif-deleted", "tag": "e7fe02cf-3cdb-4054-82e9-d944964153e3"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:17.790579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-ae0f0365-91fa-421d-abc4-3247b616aeca req-a9a22fdd-ef1e-40d2-a4c0-201901355997 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:17.791533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-ae0f0365-91fa-421d-abc4-3247b616aeca req-a9a22fdd-ef1e-40d2-a4c0-201901355997 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:17.808729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-ae0f0365-91fa-421d-abc4-3247b616aeca req-a9a22fdd-ef1e-40d2-a4c0-201901355997 service nova] Creating event network-vif-deleted:e7fe02cf-3cdb-4054-82e9-d944964153e3 for instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 on hv-cinder-81914 Jul 20 19:33:17.826034 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-ae0f0365-91fa-421d-abc4-3247b616aeca req-a9a22fdd-ef1e-40d2-a4c0-201901355997 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053558 Jul 20 19:33:17.830839 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 449/905] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:18.675696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:18.676458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:18.683289 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.683610 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.684468 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:18.684916 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:18.699759 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 HTTP/1.1 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:33:18.701417 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:33:18.703178 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'feb62e6d-0304-4ea4-99cd-d08cfaef4834'} Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:18.704213 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:33:18.705874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:33:18.707340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:18.707340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8c789dc6-e565-4318-a9ec-73797bd031fd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 404 len: 111 microversion: 2.1 time: 0.031737 Jul 20 19:33:18.707340 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 457/906] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:18 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:18.714181 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-679b97f4-7f7f-4ddd-90f6-ad913443828a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '.version_select at 0x7f26c137f670>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:18.732525 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-679b97f4-7f7f-4ddd-90f6-ad913443828a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700621114" status: 202 len: 0 microversion: 2.1 time: 0.024169 Jul 20 19:33:18.733021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 450/907] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 19:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700621114 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:33:19.103954 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-417a71cc-c49b-46a3-ad65-c9f16d47c1de tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] Calling method '.version_select at 0x7f26c13efee0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.131177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-417a71cc-c49b-46a3-ad65-c9f16d47c1de tempest-TestVolumeBootPattern-1389076127 tempest-TestVolumeBootPattern-1389076127-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1218028535" status: 202 len: 0 microversion: 2.1 time: 0.031098 Jul 20 19:33:19.132341 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 458/908] 10.222.0.43 () {58 vars in 1262 bytes} [Wed Jul 20 19:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1218028535 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:33:19.447090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.447704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:19.453973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.454425 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.455869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.456326 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.538597 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lazy-loading 'services' on Instance uuid e4c7e031-3c69-4679-bc2b-2e144ec5952e {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:33:19.613165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-57af8451-2e29-499a-a1a9-c419fdfb1dbc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments/a82d7be6-7021-4cf3-853f-01ae0022555e" status: 202 len: 0 microversion: 2.1 time: 0.169717 Jul 20 19:33:19.613659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 451/909] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:33:19 2022] DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments/a82d7be6-7021-4cf3-853f-01ae0022555e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:33:19.621817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:19.622753 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:19.631307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.631997 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.633830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:19.634578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:19.669176 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4476b235-6fad-434a-9fd7-6e5e4a322539 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051237 Jul 20 19:33:19.670045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 459/910] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:33:19 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:20.682165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.683108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.689827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.690305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.691350 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.691793 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.722876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f88824f1-9065-4d03-a36c-bb1958f51020 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045569 Jul 20 19:33:20.723454 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 452/911] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:33:20 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:33:20.780148 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.780718 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.787886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.788374 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.789157 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.789597 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.817077 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:33:20.868521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:20.903233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6c8d273a-6e71-4533-875c-a4b99fa95761 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 204 len: 0 microversion: 2.1 time: 0.126410 Jul 20 19:33:20.904416 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 460/912] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:33:20 2022] DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:33:20.912603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:20.913461 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:20.919723 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.920242 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:20.921192 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:20.921685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:21.087844 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:21.097715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bfd45f3e-5856-4a4c-bf01-9e0c0e545c53 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1680 microversion: 2.1 time: 0.188966 Jul 20 19:33:21.098306 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 453/913] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:20 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:22.117813 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:22.119420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:22.128559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.129012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.130001 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:22.130543 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:22.365624 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:22.372811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0b2bf7f7-f41f-4f1b-9907-222fd2a3bc96 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1680 microversion: 2.1 time: 0.260314 Jul 20 19:33:22.373476 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 461/914] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:22 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1680 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:23.391792 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:23.393888 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:23.401641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.402356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.404200 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.404827 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.485255 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:23.495824 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a1127fcc-165d-48ec-b25b-399f36a364d0 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 200 len: 1612 microversion: 2.1 time: 0.107927 Jul 20 19:33:23.496664 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 454/915] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:23 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:23.650493 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-4cbe2ff3-7402-449f-ab4d-6e805dcbd6e7 req-5fc2df6a-6f5d-48ad-8b84-30d66b33dfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4c7e031-3c69-4679-bc2b-2e144ec5952e", "name": "network-vif-deleted", "tag": "a87bdbd5-2067-4857-be31-d686671b3573"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:23.661510 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-4cbe2ff3-7402-449f-ab4d-6e805dcbd6e7 req-5fc2df6a-6f5d-48ad-8b84-30d66b33dfd1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:23.662199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-4cbe2ff3-7402-449f-ab4d-6e805dcbd6e7 req-5fc2df6a-6f5d-48ad-8b84-30d66b33dfd1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:23.675151 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-4cbe2ff3-7402-449f-ab4d-6e805dcbd6e7 req-5fc2df6a-6f5d-48ad-8b84-30d66b33dfd1 service nova] Creating event network-vif-deleted:a87bdbd5-2067-4857-be31-d686671b3573 for instance e4c7e031-3c69-4679-bc2b-2e144ec5952e on hv-cinder-81914 Jul 20 19:33:23.681218 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-4cbe2ff3-7402-449f-ab4d-6e805dcbd6e7 req-5fc2df6a-6f5d-48ad-8b84-30d66b33dfd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033937 Jul 20 19:33:23.685687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 462/916] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:24.522154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:24.526301 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:24.534002 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.534759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.537714 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:24.538236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e HTTP/1.1 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:33:24.560929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:33:24.562421 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'e4c7e031-3c69-4679-bc2b-2e144ec5952e'} Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:33:24.563155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:33:24.566528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:33:24.569054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:33:24.569054 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e6b55efd-7d5a-4fd7-b0d6-650c7bbdbc19 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 404 len: 111 microversion: 2.1 time: 0.048159 Jul 20 19:33:24.570048 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 455/917] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:24 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:24.574422 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-32bdf94d-0042-4055-9711-be1246d2456d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '.version_select at 0x7f26c14371f0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:24.598967 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-32bdf94d-0042-4055-9711-be1246d2456d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59061762" status: 202 len: 0 microversion: 2.1 time: 0.030052 Jul 20 19:33:24.604075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 463/918] 10.222.0.43 () {58 vars in 1214 bytes} [Wed Jul 20 19:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59061762 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:33:25.318778 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-75a15234-0609-40fd-9a03-56ed9e71f825 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: .version_select at 0x7f26c1421160>, body: {"keypair": {"name": "tempest-keypair-699321469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJirdYyDvMuw4G47rUbvGYj1GmN3UuUIVtVt1a2bdHs3DofopfcsVis0ICKLv9K/TLFwr6OxCGWLBWo+HEk7He/a1pg2CwkYpfIgy5IqM/75L40Vd2XDEYglHoK/dc0bng=="}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:25.333305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-75a15234-0609-40fd-9a03-56ed9e71f825 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:33:25.337588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-75a15234-0609-40fd-9a03-56ed9e71f825 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:33:25.362575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-75a15234-0609-40fd-9a03-56ed9e71f825 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048496 Jul 20 19:33:25.367003 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 456/919] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:33:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:26.918435 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-192882209", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1f9468-ee30-4ff5-9d99-0240a7903291"}], "security_groups": [{"name": "tempest-securitygroup--777809653"}], "key_name": "tempest-keypair-699321469", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:27.033933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] validate_networks() for [('8d1f9468-ee30-4ff5-9d99-0240a7903291', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:33:27.780024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:33:27.780474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:33:27.780948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:33:27.781552 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:33:27.781955 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:33:27.790677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.791125 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.791966 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:27.792428 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:27.808463 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:33:27.812342 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:33:27.823781 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:33:27.826099 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:33:27.873086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-90a95176-5221-41a1-9e82-321ae0171898 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.959726 Jul 20 19:33:27.873731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 464/920] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:33:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:33:27.884791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bc52a661-2ddc-4aaa-8b77-5b2643181548 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:27.885392 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bc52a661-2ddc-4aaa-8b77-5b2643181548 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:27.937092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bc52a661-2ddc-4aaa-8b77-5b2643181548 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:27.946596 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bc52a661-2ddc-4aaa-8b77-5b2643181548 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1240 microversion: 2.1 time: 0.066227 Jul 20 19:33:27.947506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 457/921] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:27 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:28.966737 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:28.967493 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:28.975839 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.976319 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:28.977116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:28.977566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:29.041355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:29.049102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-61cd2a7e-80eb-4170-ab23-9d628308c054 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1298 microversion: 2.1 time: 0.088058 Jul 20 19:33:29.049672 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 465/922] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:28 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:30.066438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:30.067135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:30.075150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.076717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.077702 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.078312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.252495 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:30.259962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-00800b8c-37ff-4e27-baf6-304245b701e8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.197582 Jul 20 19:33:30.260561 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 458/923] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:30 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:33:30.366309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-44263eed-1a89-4780-903f-c5086e80b1a1 req-0a954984-1922-4adf-9a03-a05db8ad1766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b31a538-5da9-486d-84bb-0e8e41aedf2b", "tag": "9e047325-4293-4e78-aab6-5ab3e74e8b81"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:30.375767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-44263eed-1a89-4780-903f-c5086e80b1a1 req-0a954984-1922-4adf-9a03-a05db8ad1766 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:30.376482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-44263eed-1a89-4780-903f-c5086e80b1a1 req-0a954984-1922-4adf-9a03-a05db8ad1766 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:30.389017 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-44263eed-1a89-4780-903f-c5086e80b1a1 req-0a954984-1922-4adf-9a03-a05db8ad1766 service nova] Creating event network-changed:9e047325-4293-4e78-aab6-5ab3e74e8b81 for instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b on hv-cinder-81914 Jul 20 19:33:30.394662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-44263eed-1a89-4780-903f-c5086e80b1a1 req-0a954984-1922-4adf-9a03-a05db8ad1766 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040186 Jul 20 19:33:30.395349 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 466/924] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:31.277443 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:31.278058 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:31.284666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.285118 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.285887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:31.286356 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:31.290493 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:31.417235 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:31.425305 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-34e61844-0492-4122-bb8a-2f66067b0da6 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.151710 Jul 20 19:33:31.425870 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 459/925] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:31 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:32.449604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:32.450308 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:32.457923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.458389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.459171 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:32.459619 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:32.589149 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:32.597248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8ee4b3fc-2d42-470b-a80f-b6eb32e003b5 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.151934 Jul 20 19:33:32.597812 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 467/926] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:32 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:33.614115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:33.614658 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:33.621076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.621523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.622281 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:33.622717 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:33.752227 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:33.760262 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bbe5c0ea-fa89-46e9-95b9-ebccb4f58fc8 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.150063 Jul 20 19:33:33.761059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 460/927] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:33 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:34.779957 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:34.780590 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:34.788150 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.788636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.789419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:34.789865 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:34.919374 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:34.927330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2d333bf0-b934-409b-854c-7d58f9e9f22f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.151385 Jul 20 19:33:34.927898 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 468/928] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:34 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:35.944606 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:35.945487 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:35.947843 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:35.953530 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.954070 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.955438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:35.955917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:35.995822 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-1922ad99-f4e8-4850-9619-69a626729667 req-65cab8e3-bf99-44c9-84f5-ded65c81dcf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b31a538-5da9-486d-84bb-0e8e41aedf2b", "name": "network-vif-plugged", "status": "completed", "tag": "9e047325-4293-4e78-aab6-5ab3e74e8b81"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:35.999644 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:36.007449 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-1922ad99-f4e8-4850-9619-69a626729667 req-65cab8e3-bf99-44c9-84f5-ded65c81dcf8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:36.008120 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-1922ad99-f4e8-4850-9619-69a626729667 req-65cab8e3-bf99-44c9-84f5-ded65c81dcf8 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:36.024620 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-1922ad99-f4e8-4850-9619-69a626729667 req-65cab8e3-bf99-44c9-84f5-ded65c81dcf8 service nova] Creating event network-vif-plugged:9e047325-4293-4e78-aab6-5ab3e74e8b81 for instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b on hv-cinder-81914 Jul 20 19:33:36.029963 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-1922ad99-f4e8-4850-9619-69a626729667 req-65cab8e3-bf99-44c9-84f5-ded65c81dcf8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038403 Jul 20 19:33:36.030841 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 469/929] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:36.102250 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:36.110101 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-01d4d9da-b366-4234-9209-80d1e3fa1eca tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.169502 Jul 20 19:33:36.110743 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 461/930] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:35 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:37.128346 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:37.129040 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:37.135574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.136024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.136814 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:37.137246 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:37.272885 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:37.280261 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-90bcca87-9e07-4479-a5e0-4c8917ab7f5f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1365 microversion: 2.1 time: 0.156954 Jul 20 19:33:37.280844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 470/931] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:37 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:38.297638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:38.298791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:38.301271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:38.306818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.307269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.308041 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.308513 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.445308 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:33:38.452697 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d89ab5cc-16d5-4e0e-a639-64753c43acfd tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1555 microversion: 2.1 time: 0.158921 Jul 20 19:33:38.453312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 462/932] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:33:38 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:33:38.469072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:33:38.470074 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:33:38.472006 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:38.472703 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:38.478992 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.479441 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.480199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:38.480659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:38.557775 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-aa54a803-c6d6-4b50-a87d-903379969742 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092490 Jul 20 19:33:38.558364 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 471/933] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:33:38 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:33:39.491394 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-b28cdc26-bd94-4a2d-b61f-b4f7cd2f3012 req-39173e68-034a-4a68-8213-400a7fcd1eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b31a538-5da9-486d-84bb-0e8e41aedf2b", "tag": "9e047325-4293-4e78-aab6-5ab3e74e8b81"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:33:39.500173 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-b28cdc26-bd94-4a2d-b61f-b4f7cd2f3012 req-39173e68-034a-4a68-8213-400a7fcd1eb1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:33:39.501162 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-b28cdc26-bd94-4a2d-b61f-b4f7cd2f3012 req-39173e68-034a-4a68-8213-400a7fcd1eb1 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:33:39.515001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-b28cdc26-bd94-4a2d-b61f-b4f7cd2f3012 req-39173e68-034a-4a68-8213-400a7fcd1eb1 service nova] Creating event network-changed:9e047325-4293-4e78-aab6-5ab3e74e8b81 for instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b on hv-cinder-81914 Jul 20 19:33:39.520625 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-b28cdc26-bd94-4a2d-b61f-b4f7cd2f3012 req-39173e68-034a-4a68-8213-400a7fcd1eb1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Jul 20 19:33:39.521244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 463/934] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:15.643072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=5 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:15.643983 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=42 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:15.648526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:15.649012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:15.655816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.656272 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.657097 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:15.657537 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:15.680676 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f2e13861-f8ee-4276-b47c-33b95df0f1ce tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/ips" status: 200 len: 149 microversion: 2.1 time: 0.038888 Jul 20 19:34:15.681241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 472/935] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:34:15 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:16.997256 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=5 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:16.997991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=24 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:17.002534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76e78a75-2394-4bdc-9cc8-7516280debec"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:17.003675 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:17.011016 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.011459 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.012208 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:17.012660 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:17.492152 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9e1fc1bb-45f6-41ad-a9a6-331114112070 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496216 Jul 20 19:34:17.494380 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 464/936] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:34:16 2022] POST /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:20.744577 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:20.745116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.751639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.752095 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.752900 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.753388 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.776729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lazy-loading 'flavor' on Instance uuid 6c7e4cee-d155-484a-869d-76918615ec77 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:20.844886 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5e61cd51-051a-45d7-a512-51cdaf96314a tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "POST /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77/action" status: 202 len: 0 microversion: 2.1 time: 0.104100 Jul 20 19:34:20.845472 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 473/937] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:34:20 2022] POST /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 19:34:20.854527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:20.855311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:20.861878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.862407 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.863252 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:20.863762 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:20.999110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:21.007137 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e3d4ece7-8e6e-4c05-99d7-0d2ed9130e74 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.157224 Jul 20 19:34:21.007693 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 465/938] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:20 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:22.026764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:22.027368 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:22.033564 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.034012 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.034774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:22.035215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:22.268998 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:22.277277 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a2185ee4-14bf-4591-a8b3-163d2bf6f759 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.255239 Jul 20 19:34:22.277776 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 474/939] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:22 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:23.294321 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:23.294923 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:23.301372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.301820 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.302582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:23.303018 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:23.431243 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:23.439015 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-666af03a-d293-4f27-8953-bdfb8c7f5491 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.148340 Jul 20 19:34:23.439575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 466/940] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:23 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:24.456714 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:24.457320 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:24.463443 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.463890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.464702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.465130 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.595964 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:24.604038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2c1621d8-11e1-4295-9816-a943b128f382 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.151365 Jul 20 19:34:24.604625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 475/941] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:24 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:24.979622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76e78a75-2394-4bdc-9cc8-7516280debec"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:24.981046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:24.987447 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.987895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:24.988677 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:24.989112 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.065155 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: POST /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments HTTP/1.1 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 74 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:34:25.066918 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {"volumeAttachment": {"volumeId": "76e78a75-2394-4bdc-9cc8-7516280debec"}} Jul 20 19:34:25.068972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'server_id': '6b31a538-5da9-486d-84bb-0e8e41aedf2b', 'body': {'volumeAttachment': {'volumeId': '76e78a75-2394-4bdc-9cc8-7516280debec'}}} Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:25.070285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:25.071555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 400 to user: Invalid volume: volume 76e78a75-2394-4bdc-9cc8-7516280debec is already attached to instances: 6b31a538-5da9-486d-84bb-0e8e41aedf2b {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cc52816e-41f4-490f-bd5f-c203832368ec tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093298 Jul 20 19:34:25.073180 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 467/942] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:34:24 2022] POST /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 19:34:25.128174 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.128636 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.135128 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.135582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.136369 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.136811 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.219795 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lazy-loading 'services' on Instance uuid 6b31a538-5da9-486d-84bb-0e8e41aedf2b {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:34:25.291917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6ac03672-f2d5-43cc-8fbf-a7c08b9a1e37 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments/76e78a75-2394-4bdc-9cc8-7516280debec" status: 202 len: 0 microversion: 2.1 time: 0.167572 Jul 20 19:34:25.292538 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 476/943] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:34:25 2022] DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments/76e78a75-2394-4bdc-9cc8-7516280debec => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:25.300954 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.301876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.309289 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.310088 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.311087 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.311770 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.342498 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1dcf747b-e6a5-43e2-925d-11284f3bf887 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Jul 20 19:34:25.343063 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 468/944] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:25 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:25.621709 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:25.622400 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:25.628761 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.629210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.629975 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:25.630506 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:25.761015 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:25.768585 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9b7899ed-65de-445f-b118-181d59c9e35b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.151540 Jul 20 19:34:25.769163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 477/945] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:25 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:26.353810 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.354730 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.361110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.361552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.362300 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.362729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.391110 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f4ff1d73-0a44-48d5-ba88-911a3cdbdeaf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041821 Jul 20 19:34:26.391641 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 469/946] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:34:26.448706 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.449198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.455681 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.456126 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.456927 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.457357 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.482091 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:34:26.555760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a66be2e9-ee75-4a69-987a-86e08d697ba2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 204 len: 0 microversion: 2.1 time: 0.110076 Jul 20 19:34:26.555760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 478/947] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:34:26 2022] DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:34:26.564908 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.565534 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.573873 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.574323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.575226 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.575666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.705176 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.712586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6b088f0c-2997-4ebc-a1cd-6eca9ad9c306 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1679 microversion: 2.1 time: 0.152287 Jul 20 19:34:26.713146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 470/948] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:26.785517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:26.786241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:26.793239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.793689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.794454 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:26.794892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:26.922908 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:26.930421 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-634651df-8cc3-4597-8707-df7be2db81ff tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.149095 Jul 20 19:34:26.930989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 479/949] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:26 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:27.729878 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.730500 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.737173 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.737626 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.738387 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.738821 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.866763 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:27.874525 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6967ab87-ac42-482e-807a-1997fe5aa3a4 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1679 microversion: 2.1 time: 0.148612 Jul 20 19:34:27.875078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 471/950] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:27.948155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:27.948796 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:27.955490 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.955947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:27.956767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:27.957214 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.100507 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:28.107986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-9366fcca-e4f4-4d92-85bd-0d3bc398df13 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.163783 Jul 20 19:34:28.108578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 480/951] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:27 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:28.892127 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:28.892976 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:28.900378 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.900826 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.901591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:28.902049 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:28.977105 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:28.984679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e45850e7-6401-466d-aaf6-ed33e83b4c2a tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 200 len: 1612 microversion: 2.1 time: 0.096438 Jul 20 19:34:28.985244 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 472/952] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:28 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 1612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:29.125915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:29.127238 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:29.134799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.135247 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.136217 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.136682 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.144969 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-aecdf1f0-23f9-4130-bc53-6c3e9263e1da req-a66bfc98-e824-42fa-9aaf-9478af489f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b31a538-5da9-486d-84bb-0e8e41aedf2b", "name": "network-vif-deleted", "tag": "9e047325-4293-4e78-aab6-5ab3e74e8b81"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:29.154167 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-aecdf1f0-23f9-4130-bc53-6c3e9263e1da req-a66bfc98-e824-42fa-9aaf-9478af489f32 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:29.154527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-aecdf1f0-23f9-4130-bc53-6c3e9263e1da req-a66bfc98-e824-42fa-9aaf-9478af489f32 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:29.167659 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-aecdf1f0-23f9-4130-bc53-6c3e9263e1da req-a66bfc98-e824-42fa-9aaf-9478af489f32 service nova] Creating event network-vif-deleted:9e047325-4293-4e78-aab6-5ab3e74e8b81 for instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b on hv-cinder-81914 Jul 20 19:34:29.173094 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-aecdf1f0-23f9-4130-bc53-6c3e9263e1da req-a66bfc98-e824-42fa-9aaf-9478af489f32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031653 Jul 20 19:34:29.178533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 473/953] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:29.312979 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:29.322604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7f9e8a02-1ee0-4d42-ac57-b60956343030 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.200411 Jul 20 19:34:29.323215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 481/954] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:29 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:30.002628 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:30.003319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:30.009469 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.009914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.010673 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.011106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.024771 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b HTTP/1.1 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:34:30.026432 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:34:30.028210 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '6b31a538-5da9-486d-84bb-0e8e41aedf2b'} Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:34:30.029069 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:34:30.030360 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:34:30.031517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:34:30.031517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ac3737e8-92e6-45ff-8644-4393ace3bfb1 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jul 20 19:34:30.031517 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 474/955] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:29 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:34:30.037437 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-011afdf6-2041-4cd7-bdda-ffdf8a8a6345 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '.version_select at 0x7f26c1538c10>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:30.056838 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-011afdf6-2041-4cd7-bdda-ffdf8a8a6345 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699321469" status: 202 len: 0 microversion: 2.1 time: 0.023704 Jul 20 19:34:30.057533 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 482/956] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jul 20 19:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699321469 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:30.340609 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:30.341211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:30.347340 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.347780 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.348562 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:30.349047 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:30.575239 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:30.583011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-78f8187b-1fdb-49fd-b463-6689cff2f64c tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.246145 Jul 20 19:34:30.583603 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 475/957] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:30 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:30.767432 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-484f9cab-18a8-4df1-9cc6-b8f0155e9b47 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: .version_select at 0x7f26c1497310>, body: {"keypair": {"name": "tempest-keypair-1958679301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESGEjZKupEW4VZ7WNivZcM4f6R9GzN26+dt1kAibha+jtW0m4eDE50gbg3ppb9sdqhCGuNtF3fque52lHhJsNhhxFfjiX1hkXifI9ieM4v1rFih2IzNlY1xucK+Me+rPA=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:30.781976 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-484f9cab-18a8-4df1-9cc6-b8f0155e9b47 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:34:30.785689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-484f9cab-18a8-4df1-9cc6-b8f0155e9b47 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:34:30.807914 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-484f9cab-18a8-4df1-9cc6-b8f0155e9b47 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045090 Jul 20 19:34:30.808549 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 483/958] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:34:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:31.601009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:31.601782 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:31.608601 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.609297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.610166 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:31.610704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:31.750755 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:31.759449 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d75e6fb7-8ba2-4c7f-afe3-5aa9e125089e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.162902 Jul 20 19:34:31.760106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 476/959] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:31 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.093129 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1328646902", "imageRef": "6168d6cd-f540-4072-b30e-bb01e23204dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d1f9468-ee30-4ff5-9d99-0240a7903291"}], "security_groups": [{"name": "tempest-securitygroup--1475871065"}], "key_name": "tempest-keypair-1958679301", "user_data": "}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:32.191165 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.network.neutron [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] validate_networks() for [('8d1f9468-ee30-4ff5-9d99-0240a7903291', None, None, None, None, None)] {{(pid=117768) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:34:32.555074 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:34:32.555495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image limits 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:34:32.555961 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Flavor pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:34:32.556393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Image pref 0:0:0 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:34:32.556801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.virt.hardware [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117768) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:34:32.565783 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.566227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.567016 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.567481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.584082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:34:32.588019 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Getting quotas for user 5ad489ddbd3541d0b55d884bbc7f78f3 and project ba897ed63f434ec88f93da1cae7024f1. Resources: {'ram', 'cores', 'instances'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:34:32.599381 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Going to run 1 instances... {{(pid=117768) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:34:32.601593 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6168d6cd-f540-4072-b30e-bb01e23204dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117768) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:34:32.648028 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d1a2b876-fe00-4633-a17e-aa668c76c2fa tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559752 Jul 20 19:34:32.648722 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 484/960] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:34:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:34:32.658774 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-6ab52895-3660-4982-b146-62540782e133 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.659372 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-6ab52895-3660-4982-b146-62540782e133 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.712639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-6ab52895-3660-4982-b146-62540782e133 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.719274 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-6ab52895-3660-4982-b146-62540782e133 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1242 microversion: 2.1 time: 0.064353 Jul 20 19:34:32.719978 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 477/961] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:32.777193 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:32.777802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:32.784366 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.784822 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.785601 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:32.786118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:32.926209 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:32.934802 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e970b091-ee0e-4f7b-914c-ae249b31294e tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.161714 Jul 20 19:34:32.935470 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 485/962] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:32 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:33.737768 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:33.738612 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:33.746868 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.747331 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.748353 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.748799 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.846746 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:33.855855 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5ac8a7c1-347b-497b-8584-1015da2b02bc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1302 microversion: 2.1 time: 0.122688 Jul 20 19:34:33.856269 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 478/963] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:33 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:33.952269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:33.953083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:33.960429 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.960875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:33.961638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:33.962069 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.099580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:34.109042 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6e358824-0e33-4e54-ad36-243792720497 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.160500 Jul 20 19:34:34.110079 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 486/964] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:33 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:34.873386 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:34.874001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:34.881051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.881513 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:34.882402 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:34.882849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.098408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.107609 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f0b51d59-f933-43a1-bf57-f8eba481134b tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.238467 Jul 20 19:34:35.108467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 479/965] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:34 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:35.126974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:35.127580 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:35.134387 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.134844 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.135825 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.136264 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.152764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:35.285328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.297879 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-e1b9cc36-8b6c-4269-959f-a411020103f7 req-a69421c1-c845-43ab-a8c8-a60ff43ab410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa24768-0450-4fd9-8624-776dbe0e7128", "tag": "f47f855e-f6bc-4ba5-b475-43d7d8544c8f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:35.301061 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b963c004-6fa6-462c-a91a-c127eadb1ebb tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1509 microversion: 2.1 time: 0.177840 Jul 20 19:34:35.317150 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-e1b9cc36-8b6c-4269-959f-a411020103f7 req-a69421c1-c845-43ab-a8c8-a60ff43ab410 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.317720 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-e1b9cc36-8b6c-4269-959f-a411020103f7 req-a69421c1-c845-43ab-a8c8-a60ff43ab410 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.321413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 487/966] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:35 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:35.328694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:35.329355 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:35.330547 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-e1b9cc36-8b6c-4269-959f-a411020103f7 req-a69421c1-c845-43ab-a8c8-a60ff43ab410 service nova] Creating event network-changed:f47f855e-f6bc-4ba5-b475-43d7d8544c8f for instance 1fa24768-0450-4fd9-8624-776dbe0e7128 on hv-cinder-81914 Jul 20 19:34:35.336205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-e1b9cc36-8b6c-4269-959f-a411020103f7 req-a69421c1-c845-43ab-a8c8-a60ff43ab410 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042337 Jul 20 19:34:35.336840 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 480/967] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:34:35.344596 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.345105 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.346060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.348725 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.439004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-cd30e668-fcdb-4802-990f-68dc3e7058f9 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "POST /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77/action" status: 202 len: 0 microversion: 2.1 time: 0.111560 Jul 20 19:34:35.439835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 488/968] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:34:35 2022] POST /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:34:35.449009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:35.449579 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:35.457142 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.457523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.458881 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:35.459312 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:35.691474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:35.703292 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a59854d9-1b46-457a-bd11-2ffc027458ed tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1517 microversion: 2.1 time: 0.258465 Jul 20 19:34:35.713669 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 481/969] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:35 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:36.126323 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:36.126927 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:36.134071 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.134657 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.135270 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.135704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.270917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:36.278419 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-25a1e50a-f1c7-412f-81e5-6efbed7eb74f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.156726 Jul 20 19:34:36.278978 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 489/970] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:36 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:36.721271 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:36.721872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:36.729136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.729564 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.730324 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:36.730754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:36.734716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:37.172731 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.180531 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-19fe0c50-a2b6-4541-965c-9f3dd736f7c4 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1517 microversion: 2.1 time: 0.463028 Jul 20 19:34:37.181095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 482/971] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:36 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1517 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:37.294992 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:37.295597 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:37.302738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.303397 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.304167 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:37.304633 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:37.454067 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:37.462380 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-62ff28f9-a639-4ed5-ae55-cfefdcf68231 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.171247 Jul 20 19:34:37.463199 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 490/972] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:37 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:38.198228 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:38.199957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:38.207178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.208553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.209314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.209808 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.305869 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-99bd7c8e-e2a3-45cd-882c-5bfbd130f592 req-f229da2c-7831-4a28-906f-b3f69902ccac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "name": "network-vif-unplugged", "status": "completed", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:38.317723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-99bd7c8e-e2a3-45cd-882c-5bfbd130f592 req-f229da2c-7831-4a28-906f-b3f69902ccac service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.318557 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-99bd7c8e-e2a3-45cd-882c-5bfbd130f592 req-f229da2c-7831-4a28-906f-b3f69902ccac service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.331687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-99bd7c8e-e2a3-45cd-882c-5bfbd130f592 req-f229da2c-7831-4a28-906f-b3f69902ccac service nova] Creating event network-vif-unplugged:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:34:38.343013 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-99bd7c8e-e2a3-45cd-882c-5bfbd130f592 req-f229da2c-7831-4a28-906f-b3f69902ccac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041195 Jul 20 19:34:38.344253 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 491/973] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:38.429480 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.445319 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-69beb8ac-a9d3-43a3-ab8d-8e949efe765f tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.251053 Jul 20 19:34:38.445913 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 483/974] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:38 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:38.481328 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:38.482284 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:38.488660 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.489161 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.489947 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:38.490389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:38.627389 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:38.635531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-310f1c94-87d7-4dc9-838a-130666405248 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.159973 Jul 20 19:34:38.635924 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 492/975] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:38 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:39.462637 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:39.463258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:39.469814 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.470267 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.471033 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.471477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.605066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.612504 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e03b7a11-a019-4deb-be6f-7656ebce7318 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.153780 Jul 20 19:34:39.613067 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 484/976] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:39 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:39.652179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:39.652823 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:39.659260 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.659711 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.660509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:39.661635 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:39.789145 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:39.796600 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0c1d1bb8-0bd3-4d23-a64f-e33f5e8ba237 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.148270 Jul 20 19:34:39.797170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 493/977] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:39 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:40.378473 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-817b055c-3e5e-4fb6-9fe5-9a723c6eed96 req-1992c452-d28f-4f55-bc99-262e6ccd42f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa24768-0450-4fd9-8624-776dbe0e7128", "name": "network-vif-plugged", "status": "completed", "tag": "f47f855e-f6bc-4ba5-b475-43d7d8544c8f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:40.387080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-817b055c-3e5e-4fb6-9fe5-9a723c6eed96 req-1992c452-d28f-4f55-bc99-262e6ccd42f5 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.387516 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-817b055c-3e5e-4fb6-9fe5-9a723c6eed96 req-1992c452-d28f-4f55-bc99-262e6ccd42f5 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.398072 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-817b055c-3e5e-4fb6-9fe5-9a723c6eed96 req-1992c452-d28f-4f55-bc99-262e6ccd42f5 service nova] Creating event network-vif-plugged:f47f855e-f6bc-4ba5-b475-43d7d8544c8f for instance 1fa24768-0450-4fd9-8624-776dbe0e7128 on hv-cinder-81914 Jul 20 19:34:40.402991 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-817b055c-3e5e-4fb6-9fe5-9a723c6eed96 req-1992c452-d28f-4f55-bc99-262e6ccd42f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028167 Jul 20 19:34:40.403584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 485/978] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:40.630241 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:40.630948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:40.637055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.637606 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.638413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.638853 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.766361 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.773875 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-711a7ee0-5435-47b6-b359-341538ed3387 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.148180 Jul 20 19:34:40.774444 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 494/979] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:40 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:40.814450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:40.815138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:40.821311 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.821759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.822521 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:40.822957 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:40.952055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:40.959529 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-97ce9983-9f0e-494e-9c7b-a1cb98791b99 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.150019 Jul 20 19:34:40.960092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 486/980] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:40 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:41.790899 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:41.791568 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:41.798197 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.798647 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.799420 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.799850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.933465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:41.941403 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b5aea2b0-18b7-4d4f-a01d-b7ad6df54b2b tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.154498 Jul 20 19:34:41.942079 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 495/981] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:41 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:41.976262 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:41.976895 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:41.983438 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.983883 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:41.984692 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:41.985133 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.124080 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:42.133982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e566707a-e9de-40d2-ab3c-7e23b09896ad tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1368 microversion: 2.1 time: 0.161157 Jul 20 19:34:42.135077 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 487/982] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:41 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:34:42.959592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:42.960228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:42.962205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=2 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:42.962857 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=10 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:42.969190 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.969645 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:42.970535 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:42.971148 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.101258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.108679 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-656af7b7-5efa-4d40-a512-8cde3f1814f1 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.153580 Jul 20 19:34:43.109248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 496/983] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:42 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:43.157557 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:43.158164 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:43.160103 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:43.165903 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.166388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.167120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.167549 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.293556 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:43.300953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ba8427d8-9595-4f8c-b3cd-33a8f5ea6e4f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1559 microversion: 2.1 time: 0.147254 Jul 20 19:34:43.302374 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 488/984] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:43 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:43.318763 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:43.319258 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:43.325260 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.325825 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.326578 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:43.327018 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:43.405907 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3246e53d-3020-4154-9c11-e932a9016407 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091649 Jul 20 19:34:43.406522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 497/985] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jul 20 19:34:43 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:44.126052 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:44.126655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:44.132949 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.133395 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.134167 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.134598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.279076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:44.287168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2c8f2471-eb3a-4b24-9c44-68ad46bed197 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.165058 Jul 20 19:34:44.287805 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 489/986] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:44 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:44.549959 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-eb53ff09-a644-418d-a7e7-16cc4bcf80a8 req-df43ff04-b246-4ecc-b406-3b2c08abe08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa24768-0450-4fd9-8624-776dbe0e7128", "tag": "f47f855e-f6bc-4ba5-b475-43d7d8544c8f"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:44.558602 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-eb53ff09-a644-418d-a7e7-16cc4bcf80a8 req-df43ff04-b246-4ecc-b406-3b2c08abe08c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:44.559055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-eb53ff09-a644-418d-a7e7-16cc4bcf80a8 req-df43ff04-b246-4ecc-b406-3b2c08abe08c service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:44.573664 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-eb53ff09-a644-418d-a7e7-16cc4bcf80a8 req-df43ff04-b246-4ecc-b406-3b2c08abe08c service nova] Creating event network-changed:f47f855e-f6bc-4ba5-b475-43d7d8544c8f for instance 1fa24768-0450-4fd9-8624-776dbe0e7128 on hv-cinder-81914 Jul 20 19:34:44.580116 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-eb53ff09-a644-418d-a7e7-16cc4bcf80a8 req-df43ff04-b246-4ecc-b406-3b2c08abe08c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034437 Jul 20 19:34:44.581102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 498/987] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:34:45.305801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:45.306469 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:45.314019 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.314722 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.315545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:45.315988 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:45.511422 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:45.519796 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-057d8950-f94d-46de-a724-e0056bb481a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1575 microversion: 2.1 time: 0.219185 Jul 20 19:34:45.525211 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 490/988] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:45 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:46.542370 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:34:46.543202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:34:46.545229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:46.550646 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.551586 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.552392 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:46.552830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:46.686786 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:34:46.696024 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dab0d859-8024-4f57-8227-d52f9f6a3563 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1562 microversion: 2.1 time: 0.158432 Jul 20 19:34:46.696900 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 499/989] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:34:46 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:34:48.144261 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-41e2056a-b6c2-4c61-bcc4-dd8989d428e0 req-f02136f8-b2ec-476e-9116-32e966f312c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "name": "network-vif-plugged", "status": "completed", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:34:48.149874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=57 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:48.154115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-41e2056a-b6c2-4c61-bcc4-dd8989d428e0 req-f02136f8-b2ec-476e-9116-32e966f312c7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:34:48.154555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-41e2056a-b6c2-4c61-bcc4-dd8989d428e0 req-f02136f8-b2ec-476e-9116-32e966f312c7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:34:48.165875 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-41e2056a-b6c2-4c61-bcc4-dd8989d428e0 req-f02136f8-b2ec-476e-9116-32e966f312c7 service nova] Creating event network-vif-plugged:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:34:48.170816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-41e2056a-b6c2-4c61-bcc4-dd8989d428e0 req-f02136f8-b2ec-476e-9116-32e966f312c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 Jul 20 19:34:48.171408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 491/990] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:22.431699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:22.432256 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:22.434467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:22.435101 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:22.441220 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.441671 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.442434 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:22.442870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:22.466740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bd0023ee-a1f1-4c19-abe3-d51109f72af7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/ips" status: 200 len: 150 microversion: 2.1 time: 0.038917 Jul 20 19:35:22.467307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 500/991] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:35:22 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:23.785284 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=50 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:23.786009 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:23.790452 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e5a4812-c9d5-4626-9c53-34e05e20290a"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:23.791604 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:23.798399 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.798838 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:23.799589 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:23.800017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:24.032906 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8b2c9483-1898-4777-aa3a-07a5547a16c7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "POST /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249109 Jul 20 19:35:24.033505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 492/992] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:35:23 2022] POST /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:31.617491 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.618031 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.624096 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.624574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.625338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.625780 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.703830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.objects.instance [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lazy-loading 'services' on Instance uuid 1fa24768-0450-4fd9-8624-776dbe0e7128 {{(pid=117768) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:35:31.779592 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-6c14560d-f6c9-4b87-96d3-9d28b8e0ff41 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments/3e5a4812-c9d5-4626-9c53-34e05e20290a" status: 202 len: 0 microversion: 2.1 time: 0.166544 Jul 20 19:35:31.780205 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 501/993] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:35:31 2022] DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments/3e5a4812-c9d5-4626-9c53-34e05e20290a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:31.789904 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:31.790965 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:31.797396 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.797753 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.798570 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:31.799083 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:31.831672 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-626fd245-1af6-4120-8aaa-575799d352d2 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Jul 20 19:35:31.832236 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 493/994] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:31 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:32.845059 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:32.846225 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:32.853082 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.853532 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.854324 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.854764 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.882656 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f4d2f73e-70b2-4df6-887e-9e1d165c6ccf tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042629 Jul 20 19:35:32.883206 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 502/995] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:35:32 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:35:32.939108 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:32.939630 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:32.946115 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.946561 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.947320 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:32.947754 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:32.973858 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Going to try to terminate instance {{(pid=117769) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:35:33.047151 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ebcaa05e-2dc3-4789-8ce2-db13fab30746 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 204 len: 0 microversion: 2.1 time: 0.111783 Jul 20 19:35:33.047972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 494/996] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:32 2022] DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:35:33.056604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:33.057227 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:33.063425 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.063897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.064687 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:33.065114 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:33.197118 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:33.204738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d65a0471-bc1b-4189-81d7-d249bcb9f6a7 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1683 microversion: 2.1 time: 0.152748 Jul 20 19:35:33.205309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 503/997] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:33 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:34.222168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:34.222887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:34.229410 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.229849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.230598 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:34.231026 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:34.363046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:34.370962 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ef6c8285-e3a6-40a0-b124-6f36e2e775fe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1683 microversion: 2.1 time: 0.152997 Jul 20 19:35:34.371527 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 495/998] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:34 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:35.388522 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:35.389137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:35.395662 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.396163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.397459 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.397897 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.461158 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ad489ddbd3541d0b55d884bbc7f78f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba897ed63f434ec88f93da1cae7024f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:35:35.468840 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-11e285dd-2e44-4855-896a-43859792245d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 200 len: 1615 microversion: 2.1 time: 0.084347 Jul 20 19:35:35.469404 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 504/999] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:35 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 1615 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:35:35.699813 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-6b499b0e-de47-4ea2-ad59-65415f674708 req-187eabe1-ca1d-48a7-a02a-bac7bfa74da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa24768-0450-4fd9-8624-776dbe0e7128", "name": "network-vif-deleted", "tag": "f47f855e-f6bc-4ba5-b475-43d7d8544c8f"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:35.708575 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6b499b0e-de47-4ea2-ad59-65415f674708 req-187eabe1-ca1d-48a7-a02a-bac7bfa74da2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:35.709017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-6b499b0e-de47-4ea2-ad59-65415f674708 req-187eabe1-ca1d-48a7-a02a-bac7bfa74da2 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:35.720132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-6b499b0e-de47-4ea2-ad59-65415f674708 req-187eabe1-ca1d-48a7-a02a-bac7bfa74da2 service nova] Creating event network-vif-deleted:f47f855e-f6bc-4ba5-b475-43d7d8544c8f for instance 1fa24768-0450-4fd9-8624-776dbe0e7128 on hv-cinder-81914 Jul 20 19:35:35.724872 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-6b499b0e-de47-4ea2-ad59-65415f674708 req-187eabe1-ca1d-48a7-a02a-bac7bfa74da2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028902 Jul 20 19:35:35.725474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 496/1000] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:36.486286 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.487003 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:36.494181 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.494638 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.495487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:36.495926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:36.511579 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 HTTP/1.1 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:36.513288 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:36.514870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '1fa24768-0450-4fd9-8624-776dbe0e7128'} Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:36.515663 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:36.517817 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:36.520179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:36.520179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-41d51610-4f19-4e41-8d58-2434ab51fedc tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 404 len: 111 microversion: 2.1 time: 0.032473 Jul 20 19:35:36.520179 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 505/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:36 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:36.525220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ba6b1357-a42c-487f-8e8f-b841a47f3a12 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '.version_select at 0x7f26c15f4280>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:36.528471 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba6b1357-a42c-487f-8e8f-b841a47f3a12 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [dedbb591-1981-4c83-ac50-d2b8ba0c2a83] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 19:35:37.536146 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba6b1357-a42c-487f-8e8f-b841a47f3a12 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [dedbb591-1981-4c83-ac50-d2b8ba0c2a83] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 47752. Jul 20 19:35:37.554539 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ba6b1357-a42c-487f-8e8f-b841a47f3a12 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958679301" status: 202 len: 0 microversion: 2.1 time: 1.034709 Jul 20 19:35:37.555135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 497/1002] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jul 20 19:35:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958679301 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:39.290190 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:39.290727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.297647 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.298106 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.298871 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.299309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.314501 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 HTTP/1.1 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:39.316070 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.317755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '1fa24768-0450-4fd9-8624-776dbe0e7128'} Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:39.318527 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.319731 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.321202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:39.321202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-91b57a61-160f-4b9b-b9dc-a2327b398f61 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 404 len: 111 microversion: 2.1 time: 0.031744 Jul 20 19:35:39.321202 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 506/1003] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:39 2022] DELETE /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:39.326089 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:39.326815 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 1fa24768-0450-4fd9-8624-776dbe0e7128] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:39.334051 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.334497 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.335277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:39.335716 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:39.350391 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 HTTP/1.1 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:39.352074 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.353727 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '1fa24768-0450-4fd9-8624-776dbe0e7128'} Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:39.355369 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. Jul 20 19:35:39.356953 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:39.358313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 1fa24768-0450-4fd9-8624-776dbe0e7128 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:39.358313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-75963145-74b2-40f7-b1b8-4f569c3ce84f tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128" status: 404 len: 111 microversion: 2.1 time: 0.031286 Jul 20 19:35:39.358313 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 498/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:39 2022] GET /compute/v2.1/servers/1fa24768-0450-4fd9-8624-776dbe0e7128 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:40.488496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.488973 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.495876 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.496353 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.497110 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.497545 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.511689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b HTTP/1.1 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:40.513283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.515049 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '6b31a538-5da9-486d-84bb-0e8e41aedf2b'} Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:40.515870 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.517413 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.518980 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:40.518980 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ab78f57e-903b-46f8-967e-9f8ec1478239 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 404 len: 111 microversion: 2.1 time: 0.030132 Jul 20 19:35:40.518980 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 507/1005] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:40 2022] DELETE /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:40.523141 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.523752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: 6b31a538-5da9-486d-84bb-0e8e41aedf2b] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.530310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.530759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.531519 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.531956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.547265 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b HTTP/1.1 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:40.548809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.550398 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '6b31a538-5da9-486d-84bb-0e8e41aedf2b'} Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:40.551297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. Jul 20 19:35:40.553332 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.554663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance 6b31a538-5da9-486d-84bb-0e8e41aedf2b could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:40.554663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-df849a47-ab80-4c1d-943b-fe9d6eb6ec8d tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b" status: 404 len: 111 microversion: 2.1 time: 0.030827 Jul 20 19:35:40.554663 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 499/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:40 2022] GET /compute/v2.1/servers/6b31a538-5da9-486d-84bb-0e8e41aedf2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 19:35:40.559926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.560457 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.566816 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.567274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.568729 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.569177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.582322 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 HTTP/1.1 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:40.583930 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.585582 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'feb62e6d-0304-4ea4-99cd-d08cfaef4834'} Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:40.586386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.587799 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.589307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:40.589307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-dcf00c12-3787-485a-9c91-912e81b44dfe tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jul 20 19:35:40.589307 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 508/1007] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:40 2022] DELETE /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:40.593862 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:40.594474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: feb62e6d-0304-4ea4-99cd-d08cfaef4834] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:40.601845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.601845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.602304 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:40.602747 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:40.616706 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 HTTP/1.1 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:40.618178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.619759 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'feb62e6d-0304-4ea4-99cd-d08cfaef4834'} Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:40.620979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. Jul 20 19:35:40.622499 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:40.623882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance feb62e6d-0304-4ea4-99cd-d08cfaef4834 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:40.623882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4aa08649-4f57-4fbc-9ed1-5448bf437411 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834" status: 404 len: 111 microversion: 2.1 time: 0.029533 Jul 20 19:35:40.623882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 500/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:40 2022] GET /compute/v2.1/servers/feb62e6d-0304-4ea4-99cd-d08cfaef4834 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:41.752182 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.752686 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.759909 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.760386 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.761143 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.761576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.774766 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e HTTP/1.1 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:41.776311 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.777926 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': 'e4c7e031-3c69-4679-bc2b-2e144ec5952e'} Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:41.778987 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.780528 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.782050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:41.782050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-8d331bfe-695c-47ce-824e-913cf95200de tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 404 len: 111 microversion: 2.1 time: 0.029335 Jul 20 19:35:41.782050 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 509/1009] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:35:41 2022] DELETE /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:41.785869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:41.786472 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] [instance: e4c7e031-3c69-4679-bc2b-2e144ec5952e] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:35:41.792973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.793414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.794163 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:35:41.794591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:35:41.808268 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] HTTP exception thrown: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Request method failure captured: Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e HTTP/1.1 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FfyyPQlnA_h0ISICdIyvY3YskHJo5c85NAT2xMHpfhBvG_3h2u_SAlqD7f4qbvlWXjCvIfXUyYx36P2OL4SHUXp0AOtiK5sJtMVtC6e6V7D52n3zscQ2K4kO_daVw97AiBXgjCx8lcYnoGJpFytNXIeRMh8YMEFAcHFsi9OlAuTFd0 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:41.809789 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ba897ed63f434ec88f93da1cae7024f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ba897ed63f434ec88f93da1cae7024f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ba897ed63f434ec88f93da1cae7024f1"}]}] Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: ba897ed63f434ec88f93da1cae7024f1 Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25279262 Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 5ad489ddbd3541d0b55d884bbc7f78f3 Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-AttachVolumeNegativeTest-25279262-project Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.811655 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'e4c7e031-3c69-4679-bc2b-2e144ec5952e'} Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:41.812695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. Jul 20 19:35:41.814234 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:41.816197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] Returning 404 to user: Instance e4c7e031-3c69-4679-bc2b-2e144ec5952e could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:41.816197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-028385e2-a566-4b12-be0e-fd61796eab42 tempest-AttachVolumeNegativeTest-25279262 tempest-AttachVolumeNegativeTest-25279262-project] 10.222.0.43 "GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e" status: 404 len: 111 microversion: 2.1 time: 0.029062 Jul 20 19:35:41.816197 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 501/1010] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:35:41 2022] GET /compute/v2.1/servers/e4c7e031-3c69-4679-bc2b-2e144ec5952e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:46.327060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-47a58b23-51a5-4cd5-8d42-15dff88fb06b tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Action: 'create', calling method: .version_select at 0x7f26c1597af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-430097885"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:46.624121 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-47a58b23-51a5-4cd5-8d42-15dff88fb06b tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.436689 Jul 20 19:35:46.624792 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 510/1011] 10.222.0.43 () {60 vars in 1154 bytes} [Wed Jul 20 19:35:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 19:35:46.635416 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5d508e8b-ad54-4161-a34b-aeeb3191ba3b tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1485ca0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:46.686505 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5d508e8b-ad54-4161-a34b-aeeb3191ba3b tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 200 len: 344 microversion: 2.1 time: 0.054522 Jul 20 19:35:46.687078 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 502/1012] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:46 2022] GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:47.700352 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-62c963b3-323e-4fab-ba53-6a519edb51c0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c15ec0d0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.748442 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-62c963b3-323e-4fab-ba53-6a519edb51c0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 200 len: 345 microversion: 2.1 time: 0.052450 Jul 20 19:35:47.749267 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 511/1013] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:47.760948 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-d16d595a-c52e-4e21-b372-238567792067 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Action: 'create', calling method: .version_select at 0x7f26c15b6a60>, body: {"snapshot": {"volume_id": "2e7db791-b87f-484b-85d3-f7e6349547a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1576205691"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:35:47.908924 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-d16d595a-c52e-4e21-b372-238567792067 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.152176 Jul 20 19:35:47.909511 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 503/1014] 10.222.0.43 () {60 vars in 1161 bytes} [Wed Jul 20 19:35:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:47.919951 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f283e186-60de-4159-9195-6d5844a15ba9 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c156c940>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.952740 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f283e186-60de-4159-9195-6d5844a15ba9 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 287 microversion: 2.1 time: 0.036445 Jul 20 19:35:47.953254 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 512/1015] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:47.962975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-4dd5438e-3263-4e15-807d-25c9e820e1f7 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1626280>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:47.991773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-4dd5438e-3263-4e15-807d-25c9e820e1f7 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032592 Jul 20 19:35:47.992665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 504/1016] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:48.002851 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-62c13b6e-c6da-4b70-809f-c183eded6c3e tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c154ee50>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:48.031995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-62c13b6e-c6da-4b70-809f-c183eded6c3e tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 287 microversion: 2.1 time: 0.032993 Jul 20 19:35:48.032594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 513/1017] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:47 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:49.044038 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-bb95c4d8-084c-4269-8fbf-1ae5a6a326fb tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c14afca0>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:49.073444 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-bb95c4d8-084c-4269-8fbf-1ae5a6a326fb tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 287 microversion: 2.1 time: 0.033595 Jul 20 19:35:49.074010 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 505/1018] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:49 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:50.089948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bd6ff73c-1156-43eb-83e5-53e0cb14a597 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c13ef790>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:50.119945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bd6ff73c-1156-43eb-83e5-53e0cb14a597 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 287 microversion: 2.1 time: 0.034302 Jul 20 19:35:50.120572 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 514/1019] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:50 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:51.131370 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c5f35d5e-edc2-49e0-8a81-cd997d38e2b2 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c15f5550>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.160220 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c5f35d5e-edc2-49e0-8a81-cd997d38e2b2 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 288 microversion: 2.1 time: 0.033136 Jul 20 19:35:51.162113 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 506/1020] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:51.172566 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2afe703e-09a8-4d0f-8ba0-a18bdb45c678 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1597820>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.229884 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2afe703e-09a8-4d0f-8ba0-a18bdb45c678 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 202 len: 0 microversion: 2.1 time: 0.061577 Jul 20 19:35:51.230532 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 515/1021] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jul 20 19:35:51 2022] DELETE /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:51.238795 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0af3fabe-e7c0-4b1c-a157-3c25dd1b541f tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1650a60>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:51.268129 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0af3fabe-e7c0-4b1c-a157-3c25dd1b541f tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 200 len: 287 microversion: 2.1 time: 0.033098 Jul 20 19:35:51.268715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 507/1022] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:51 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:35:52.276940 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=20 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.277715 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.282599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fb00f052-8267-4b3d-a86d-eb1384a1cfc0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1497a60>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.307894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-fb00f052-8267-4b3d-a86d-eb1384a1cfc0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] HTTP exception thrown: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fb00f052-8267-4b3d-a86d-eb1384a1cfc0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Request method failure captured: Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 HTTP/1.1 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FkSPW4g77yPg0NsaZqFOt25rLkc2NBE1CRtOyr0dNQXaJSRl5Wb-IOOfC_KtvTBGhJCxhqxfQwlPapaDH6lgvMCO_UH20VMy9kmOyawnW5pB3Lp3NBRlQlOpiPYQSfQSYVGNPS2mSOcwdfZh18VvqaHcf_3zHAmwN4adGF7vaK9ihU Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:52.310509 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e72a1efa7c48aaa036ea2c739c6c21", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}] Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 3bd7300087a844b586caf081c5f0fba2 Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '65fea652-3d85-4b78-bb6e-76f62372c677'} Jul 20 19:35:52.312495 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. (HTTP 404) (Request-ID: req-24b5552e-8dd0-4329-a953-61a3860ab99e) Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.313536 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:52.314934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 19:35:52.316467 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-fb00f052-8267-4b3d-a86d-eb1384a1cfc0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Returning 404 to user: Snapshot 65fea652-3d85-4b78-bb6e-76f62372c677 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:52.318618 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-fb00f052-8267-4b3d-a86d-eb1384a1cfc0 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677" status: 404 len: 111 microversion: 2.1 time: 0.036219 Jul 20 19:35:52.319594 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 516/1023] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/os-snapshots/65fea652-3d85-4b78-bb6e-76f62372c677 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:52.319684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.319684 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:52.323862 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-2ec513c5-7b1c-4b43-9e09-ea30974ed26c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c14d3160>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.388926 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-2ec513c5-7b1c-4b43-9e09-ea30974ed26c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 202 len: 0 microversion: 2.1 time: 0.071858 Jul 20 19:35:52.389510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 508/1024] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:35:52 2022] DELETE /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:35:52.400365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-37584434-f8b2-4c85-a775-214d5281364c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c154e3a0>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:52.449276 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-37584434-f8b2-4c85-a775-214d5281364c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 200 len: 344 microversion: 2.1 time: 0.053411 Jul 20 19:35:52.449864 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 517/1025] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:52 2022] GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:35:53.462818 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1823bff6-c8ad-4e3a-a259-330b7156610c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c15fc310>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:53.492721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-1823bff6-c8ad-4e3a-a259-330b7156610c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] HTTP exception thrown: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1823bff6-c8ad-4e3a-a259-330b7156610c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Request method failure captured: Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 HTTP/1.1 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FkSPW4g77yPg0NsaZqFOt25rLkc2NBE1CRtOyr0dNQXaJSRl5Wb-IOOfC_KtvTBGhJCxhqxfQwlPapaDH6lgvMCO_UH20VMy9kmOyawnW5pB3Lp3NBRlQlOpiPYQSfQSYVGNPS2mSOcwdfZh18VvqaHcf_3zHAmwN4adGF7vaK9ihU Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:53.494666 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e72a1efa7c48aaa036ea2c739c6c21", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}] Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3bd7300087a844b586caf081c5f0fba2 Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '2e7db791-b87f-484b-85d3-f7e6349547a7'} Jul 20 19:35:53.496336 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. (HTTP 404) (Request-ID: req-dbed1772-8914-4b47-84fd-a68fb1da2700) Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.497328 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:53.498773 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:35:53.500177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-1823bff6-c8ad-4e3a-a259-330b7156610c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Returning 404 to user: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-1823bff6-c8ad-4e3a-a259-330b7156610c tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 404 len: 109 microversion: 2.1 time: 0.038204 Jul 20 19:35:53.501588 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 509/1026] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:53 2022] GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:53.510920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85a33483-72f3-4851-b887-1cd245568f50 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c1437940>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:53.538445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-85a33483-72f3-4851-b887-1cd245568f50 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] HTTP exception thrown: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85a33483-72f3-4851-b887-1cd245568f50 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Request method failure captured: Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: DELETE /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 HTTP/1.1 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FkSPW4g77yPg0NsaZqFOt25rLkc2NBE1CRtOyr0dNQXaJSRl5Wb-IOOfC_KtvTBGhJCxhqxfQwlPapaDH6lgvMCO_UH20VMy9kmOyawnW5pB3Lp3NBRlQlOpiPYQSfQSYVGNPS2mSOcwdfZh18VvqaHcf_3zHAmwN4adGF7vaK9ihU Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:35:53.540890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e72a1efa7c48aaa036ea2c739c6c21", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}] Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: 3bd7300087a844b586caf081c5f0fba2 Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '2e7db791-b87f-484b-85d3-f7e6349547a7'} Jul 20 19:35:53.542556 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. (HTTP 404) (Request-ID: req-224bad8e-c3fa-431a-a878-32d380020386) Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.543531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 19:35:53.544989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 19:35:53.546574 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-85a33483-72f3-4851-b887-1cd245568f50 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Returning 404 to user: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-85a33483-72f3-4851-b887-1cd245568f50 tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 404 len: 109 microversion: 2.1 time: 0.035810 Jul 20 19:35:53.548038 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 518/1027] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jul 20 19:35:53 2022] DELETE /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:53.550679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9ab58132-eb89-4cb7-9ba2-5bba396af3aa tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Calling method '.version_select at 0x7f26c15f5160>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:35:53.577758 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-9ab58132-eb89-4cb7-9ba2-5bba396af3aa tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] HTTP exception thrown: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9ab58132-eb89-4cb7-9ba2-5bba396af3aa tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Request method failure captured: Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 HTTP/1.1 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FkSPW4g77yPg0NsaZqFOt25rLkc2NBE1CRtOyr0dNQXaJSRl5Wb-IOOfC_KtvTBGhJCxhqxfQwlPapaDH6lgvMCO_UH20VMy9kmOyawnW5pB3Lp3NBRlQlOpiPYQSfQSYVGNPS2mSOcwdfZh18VvqaHcf_3zHAmwN4adGF7vaK9ihU Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:35:53.579682 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b2e72a1efa7c48aaa036ea2c739c6c21"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b2e72a1efa7c48aaa036ea2c739c6c21", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b2e72a1efa7c48aaa036ea2c739c6c21"}]}] Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: b2e72a1efa7c48aaa036ea2c739c6c21 Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-854237858 Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 3bd7300087a844b586caf081c5f0fba2 Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-VolumesSnapshotsTestJSON-854237858-project Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': '2e7db791-b87f-484b-85d3-f7e6349547a7'} Jul 20 19:35:53.581297 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. (HTTP 404) (Request-ID: req-d5cae139-e4fb-4da9-98ab-6023a2309696) Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.582285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 19:35:53.584257 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 19:35:53.586011 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9ab58132-eb89-4cb7-9ba2-5bba396af3aa tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] Returning 404 to user: Volume 2e7db791-b87f-484b-85d3-f7e6349547a7 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9ab58132-eb89-4cb7-9ba2-5bba396af3aa tempest-VolumesSnapshotsTestJSON-854237858 tempest-VolumesSnapshotsTestJSON-854237858-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7" status: 404 len: 109 microversion: 2.1 time: 0.034347 Jul 20 19:35:53.587388 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 510/1028] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jul 20 19:35:53 2022] GET /compute/v2.1/os-volumes/2e7db791-b87f-484b-85d3-f7e6349547a7 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:06.761095 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:06.761709 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:06.769113 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.769589 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.771198 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.771760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.811026 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:36:06.912004 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-62511fa8-647e-4a1b-87b9-076049ce39dd tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 204 len: 0 microversion: 2.1 time: 0.155800 Jul 20 19:36:06.912723 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 519/1029] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:36:06 2022] DELETE /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:36:06.925103 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:06.925641 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:06.930840 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-7a4a103c-774b-4b1a-b230-965e69564e83 req-645235c2-724e-4243-8c67-bc1d468ba61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:06.938102 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.938879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.939757 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-7a4a103c-774b-4b1a-b230-965e69564e83 req-645235c2-724e-4243-8c67-bc1d468ba61f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.940025 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:06.940521 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.940721 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-7a4a103c-774b-4b1a-b230-965e69564e83 req-645235c2-724e-4243-8c67-bc1d468ba61f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:06.952622 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-7a4a103c-774b-4b1a-b230-965e69564e83 req-645235c2-724e-4243-8c67-bc1d468ba61f service nova] Creating event network-changed:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:36:06.958389 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-7a4a103c-774b-4b1a-b230-965e69564e83 req-645235c2-724e-4243-8c67-bc1d468ba61f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199001 Jul 20 19:36:06.959178 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 511/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:36:07.095142 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:07.103215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-39d9fedf-65ac-4a7a-a21b-6fff34505632 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.184830 Jul 20 19:36:07.103948 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 520/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:06 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:08.122205 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:08.122902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:08.130125 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.130731 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.131849 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:08.132584 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:08.387518 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:08.396385 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-cd779e46-9360-41f8-8127-0d10e803f779 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1568 microversion: 2.1 time: 0.278496 Jul 20 19:36:08.396963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 512/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:08 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:09.212778 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-338d2f9c-61ae-40ed-ab98-3c7ffe0835a0 req-499982f9-697f-404e-a84a-5513a9c3752f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c7e4cee-d155-484a-869d-76918615ec77", "name": "network-vif-deleted", "tag": "637fcd80-41b1-4f6e-8500-3b24bb93f24e"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:09.224438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-338d2f9c-61ae-40ed-ab98-3c7ffe0835a0 req-499982f9-697f-404e-a84a-5513a9c3752f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.224989 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-338d2f9c-61ae-40ed-ab98-3c7ffe0835a0 req-499982f9-697f-404e-a84a-5513a9c3752f service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.237860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-338d2f9c-61ae-40ed-ab98-3c7ffe0835a0 req-499982f9-697f-404e-a84a-5513a9c3752f service nova] Creating event network-vif-deleted:637fcd80-41b1-4f6e-8500-3b24bb93f24e for instance 6c7e4cee-d155-484a-869d-76918615ec77 on hv-cinder-81914 Jul 20 19:36:09.243614 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-338d2f9c-61ae-40ed-ab98-3c7ffe0835a0 req-499982f9-697f-404e-a84a-5513a9c3752f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034851 Jul 20 19:36:09.244348 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 521/1033] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 19:36:09.416736 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:09.417310 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:09.425165 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.425704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.427276 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:09.427822 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:09.513120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e97b329ce34e8ca7ca7d3e046a3136', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5d98e3bb2a4708a934a15674033c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:09.527510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e8a4998f-e07a-4f6f-9847-2ef1aa6d1836 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 200 len: 1219 microversion: 2.1 time: 0.116302 Jul 20 19:36:09.528275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 513/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:09 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:10.546032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:10.546755 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] [instance: 6c7e4cee-d155-484a-869d-76918615ec77] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:10.553390 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:10.553855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:10.554599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:10.555032 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:10.569738 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.wsgi [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] HTTP exception thrown: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Request method failure captured: Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: request: GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 HTTP/1.1 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept: application/json Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Accept-Encoding: identity Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Connection: close Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Length: 0 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Content-Type: application/json Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Host: 10.222.0.43 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Openstack-System-Scope: None Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: User-Agent: python-urllib3/1.26.9 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Auth-Token: gAAAAABi2FgGBzVMooVdzFH6-c75vA-ipnRB4wU2ICT_f978oHJdOAYJysijOX6G5S4dvVvg14GWExP5DHnGL0UZBgkJVzWNBy1ZHpRveKTdkYuIevwi4AfLxxEWuYtL4Xr8cw7CS6wDwIcIiLr_UYriRxWJ9s4RR1EX_QjEc7HczfzYEdbpgmg Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Id: None Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Domain-Name: None Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Identity-Status: Confirmed Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Is-Admin-Project: True Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Id: default Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Domain-Name: Default Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Id: 4e5d98e3bb2a4708a934a15674033c12 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Project-Name: tempest-TestShelveInstance-676796567 Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Role: reader,member Jul 20 19:36:10.571667 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Roles: reader,member Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e5d98e3bb2a4708a934a15674033c12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4e5d98e3bb2a4708a934a15674033c12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4e5d98e3bb2a4708a934a15674033c12", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4e5d98e3bb2a4708a934a15674033c12"}]}] Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant: tempest-TestShelveInstance-676796567 Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Id: 4e5d98e3bb2a4708a934a15674033c12 Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-Tenant-Name: tempest-TestShelveInstance-676796567 Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User: tempest-TestShelveInstance-676796567-project Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Id: default Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Domain-Name: Default Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Id: e1e97b329ce34e8ca7ca7d3e046a3136 Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: X-User-Name: tempest-TestShelveInstance-676796567-project Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: method: > Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: exception: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. Jul 20 19:36:10.573445 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: action_args: {'id': '6c7e4cee-d155-484a-869d-76918615ec77'} Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:36:10.574751 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. Jul 20 19:36:10.576395 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: ERROR nova.api.openstack.wsgi Jul 20 19:36:10.577830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Returning 404 to user: Instance 6c7e4cee-d155-484a-869d-76918615ec77 could not be found. {{(pid=117768) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:36:10.577830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-75c239b8-be29-427c-a410-aa1574335bee tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77" status: 404 len: 111 microversion: 2.1 time: 0.031697 Jul 20 19:36:10.577830 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 522/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:10 2022] GET /compute/v2.1/servers/6c7e4cee-d155-484a-869d-76918615ec77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:36:10.743543 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a6c78fba-76bd-4c79-9672-869605c599a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] Calling method '.version_select at 0x7f26c15b6280>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:10.764671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a6c78fba-76bd-4c79-9672-869605c599a2 tempest-TestShelveInstance-676796567 tempest-TestShelveInstance-676796567-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370730037" status: 202 len: 0 microversion: 2.1 time: 0.025106 Jul 20 19:36:10.765925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 514/1036] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jul 20 19:36:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1370730037 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:36:56.738702 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-13f6f482-3c9b-4aea-b111-b9f36924b900 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'create', calling method: .version_select at 0x7f26c18a60d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1937750479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMrgs/LrEA96BvNd40wJ1nl4yfw7XfIUmrB0i0Z83DACbK855x3X9qOGaUenb4EScq3uKjTCUZGsSye2GCdqqK3fZ6X7svDuRpJTnTKGV2PuMVQy6pyGsJM+TEu540vxw=="}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:56.742862 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:56.743526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:56.758563 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-13f6f482-3c9b-4aea-b111-b9f36924b900 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Getting quotas for project 887ce1159e3c412b9cab436ecf76737c. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:36:56.762694 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.quota [None req-13f6f482-3c9b-4aea-b111-b9f36924b900 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Getting quotas for user 1d423c82039a41cd96a2c8b25c37647f and project 887ce1159e3c412b9cab436ecf76737c. Resources: {'key_pairs'} {{(pid=117768) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:36:56.787625 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-13f6f482-3c9b-4aea-b111-b9f36924b900 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052447 Jul 20 19:36:56.788250 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 523/1037] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jul 20 19:36:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:36:56.836194 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-791584189", "imageRef": "80cb394c-4334-4650-b3c4-0b223c3df9b0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1937750479", "networks": [{"uuid": "ce8154a5-666d-4bec-bef5-4e8358d5fd01"}]}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:36:56.843157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=14 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:56.843801 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:56.888175 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.network.neutron [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] validate_networks() for [('ce8154a5-666d-4bec-bef5-4e8358d5fd01', None, None, None, None, None)] {{(pid=117769) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 19:36:57.349212 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Flavor limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 19:36:57.349751 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Image limits 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 19:36:57.350486 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Flavor pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 19:36:57.351001 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Image pref 0:0:0 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 19:36:57.351429 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.virt.hardware [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117769) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 19:36:57.360519 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.360973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.362552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:57.362552 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:57.379327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Getting quotas for project 887ce1159e3c412b9cab436ecf76737c. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 19:36:57.383970 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.quota [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Getting quotas for user 1d423c82039a41cd96a2c8b25c37647f and project 887ce1159e3c412b9cab436ecf76737c. Resources: {'ram', 'cores', 'instances'} {{(pid=117769) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 19:36:57.395045 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Going to run 1 instances... {{(pid=117769) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 19:36:57.397282 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80cb394c-4334-4650-b3c4-0b223c3df9b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117769) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 19:36:57.452665 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a46a6f8b-0b99-432b-91c0-e693eb94c98f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620797 Jul 20 19:36:57.453591 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 515/1038] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jul 20 19:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 19:36:57.467571 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-2f219f10-fe47-4b68-b26a-b4e6c6f7a7f2 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:57.468539 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-2f219f10-fe47-4b68-b26a-b4e6c6f7a7f2 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:57.529365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-2f219f10-fe47-4b68-b26a-b4e6c6f7a7f2 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:57.536120 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-2f219f10-fe47-4b68-b26a-b4e6c6f7a7f2 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1258 microversion: 2.1 time: 0.074489 Jul 20 19:36:57.536874 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 524/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:57 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:58.555433 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:58.556929 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:58.564102 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.564702 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.565686 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:58.566343 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:58.636044 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:58.643956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-c3d4cff4-216f-46d5-9ce8-b51f58166f28 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1318 microversion: 2.1 time: 0.094400 Jul 20 19:36:58.645404 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 516/1040] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:58 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:36:59.667716 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:36:59.669303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:36:59.678295 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.679075 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.679768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:36:59.680407 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:36:59.832088 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:36:59.840713 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-850f9d3d-0ba7-4efe-9fed-b61ab54f19c5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.178586 Jul 20 19:36:59.841292 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 525/1041] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:36:59 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:00.859561 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:00.860501 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:00.868920 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.869370 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:00.870157 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:00.870594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:01.019263 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:01.028479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-72ba6d8f-f335-40a3-95c9-d1f68beb4126 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.173135 Jul 20 19:37:01.030102 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 517/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:00 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 19:37:02.046115 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:02.047911 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:02.055430 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:02.055881 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:02.056835 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:02.057393 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:02.210717 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:02.222637 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-a1170b10-d949-4273-80dc-64f485763bca tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.180070 Jul 20 19:37:02.223855 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 526/1043] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:02 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:03.247059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:03.247683 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:03.254391 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.254874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.255685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:03.256122 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:03.400811 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:03.408541 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9e4b0d93-da6a-4e7f-b69e-676088d53daf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.165495 Jul 20 19:37:03.409245 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 518/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:03 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:04.427011 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:04.427704 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:04.437591 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.438045 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.438842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:04.439283 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:04.595500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:04.604104 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-934e99f6-58e2-4734-8d6b-eb9d55dd66eb tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.181767 Jul 20 19:37:04.605196 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 527/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:04 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:05.621715 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:05.622474 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:05.629135 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.629695 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.630973 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:05.631405 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:05.776096 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:05.784809 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-8c835da8-c410-44cc-951e-42f5b2b5efa0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.167106 Jul 20 19:37:05.785678 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 519/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:05 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:06.802604 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:06.803239 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:06.810479 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.810934 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.811716 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:06.812162 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:06.950203 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:06.957760 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-ef0fdd51-8951-422a-88d8-79d9cb521f9f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.159512 Jul 20 19:37:06.958974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 528/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:06 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:07.940323 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-dacf8d6a-b6fd-4336-b5e9-28424301abe2 req-5624a08a-55ea-44d8-9744-bcf7a47f4556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:07.945032 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.945928 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=6 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.956856 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-dacf8d6a-b6fd-4336-b5e9-28424301abe2 req-5624a08a-55ea-44d8-9744-bcf7a47f4556 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.959555 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-dacf8d6a-b6fd-4336-b5e9-28424301abe2 req-5624a08a-55ea-44d8-9744-bcf7a47f4556 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:07.974791 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-dacf8d6a-b6fd-4336-b5e9-28424301abe2 req-5624a08a-55ea-44d8-9744-bcf7a47f4556 service nova] Creating event network-changed:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:37:07.979917 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:07.980541 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:07.982538 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell0:SELECT=6 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.983874 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-dacf8d6a-b6fd-4336-b5e9-28424301abe2 req-5624a08a-55ea-44d8-9744-bcf7a47f4556 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048241 Jul 20 19:37:07.985002 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 520/1048] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:07.998465 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:07.998974 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:07.999774 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:08.000210 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:08.225460 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:08.233484 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-5d8d15e7-3af0-42cf-8271-92523bf2f3e1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.261985 Jul 20 19:37:08.234107 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 529/1049] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:07 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:09.251908 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:09.252621 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:09.259533 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:09.259979 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:09.260769 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:09.261201 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:09.392947 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:09.401506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-47f1e037-b9cc-41fc-a903-2efe3ae0a11f tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.154271 Jul 20 19:37:09.402082 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 521/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:09 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:10.418500 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:10.419098 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:10.425565 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.426009 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.426770 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:10.427201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:10.555309 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:10.562995 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-b0544fd6-645d-402d-b902-5cf6fb99ff9b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.148388 Jul 20 19:37:10.563602 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 530/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:10 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:11.580418 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:11.581013 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:11.588076 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.588556 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.589315 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:11.589742 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:11.729631 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:11.737258 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-724250bf-9e9a-4911-adda-a1f1f2c021aa tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.160787 Jul 20 19:37:11.737816 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 522/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:11 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:12.755689 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:12.756312 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:12.762945 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.763765 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.765030 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:12.765502 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:12.924010 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:12.933207 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-1e68f413-467b-41d1-bdd8-e1333e6c65e0 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.181453 Jul 20 19:37:12.933804 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 531/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:12 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:13.021168 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-cf55c7e1-2825-4d4e-8afe-21e7766c2e45 req-7172d322-33e5-422f-b078-321c1926ad28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "name": "network-vif-plugged", "status": "completed", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:13.029522 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-cf55c7e1-2825-4d4e-8afe-21e7766c2e45 req-7172d322-33e5-422f-b078-321c1926ad28 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.030059 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-cf55c7e1-2825-4d4e-8afe-21e7766c2e45 req-7172d322-33e5-422f-b078-321c1926ad28 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:13.041330 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-cf55c7e1-2825-4d4e-8afe-21e7766c2e45 req-7172d322-33e5-422f-b078-321c1926ad28 service nova] Creating event network-vif-plugged:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:37:13.046420 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-cf55c7e1-2825-4d4e-8afe-21e7766c2e45 req-7172d322-33e5-422f-b078-321c1926ad28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161896 Jul 20 19:37:13.046999 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 523/1054] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:13.951207 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:13.951801 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:13.958359 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.958807 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:13.959584 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:13.960019 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:14.095078 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:14.103525 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3d71edd3-eb87-4529-8484-2643823e65cf tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1358 microversion: 2.1 time: 0.156209 Jul 20 19:37:14.104098 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 532/1055] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:13 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:15.121729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.122450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:15.128992 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.129434 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.130704 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.131138 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.273266 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:15.281528 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-ce4d0c48-e9d5-4536-a81d-ea135eb3c523 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1547 microversion: 2.1 time: 0.164454 Jul 20 19:37:15.282116 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 524/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:15.298949 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.299565 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:15.308091 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.308652 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.309768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.310252 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.452850 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:15.461054 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-988ff0b6-0122-4cb9-a626-388e496fc4dd tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1547 microversion: 2.1 time: 0.166177 Jul 20 19:37:15.461659 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 533/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:15.477409 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.480987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:15.481752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Searching by: {'deleted': False, 'project_id': '887ce1159e3c412b9cab436ecf76737c'} {{(pid=117769) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 19:37:15.488796 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.489246 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.490046 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.490488 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.584277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.multi_cell_list [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117769) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 19:37:15.683177 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-f2afda18-1e5c-4d8e-8377-58e09e570150 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210074 Jul 20 19:37:15.683685 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 525/1058] 10.222.0.43 () {58 vars in 1124 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:15.697201 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:15.697973 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:15.704216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.704696 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.705478 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:15.705915 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:15.846163 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:15.853758 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3f0f88e5-b0d1-420c-8dba-781086a292d6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1547 microversion: 2.1 time: 0.163038 Jul 20 19:37:15.854344 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 534/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:15 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:17.387510 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20015f23-a38d-482a-a10f-255dee245e70"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:17.388581 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:17.395152 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.395594 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.396483 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:17.396925 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:17.635636 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-e39217e3-2bca-4989-9b56-54c581fd3911 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251827 Jul 20 19:37:17.636553 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 526/1060] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jul 20 19:37:17 2022] POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:24.117072 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:24.117721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:24.123933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.124474 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.125276 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:24.125719 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:24.256883 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:24.264890 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-43621f39-2eed-416b-baf7-51de5d1676d1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1593 microversion: 2.1 time: 0.152402 Jul 20 19:37:24.265458 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 535/1061] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:24 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:25.093526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:37:25.093767 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Wed Jul 20 19:37:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:37:26.104853 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-1740cfc4-a97f-4c8b-b80c-900cd103795f req-cb0ab280-4d71-4b37-a876-1f68d217c287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:26.112635 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell0:SELECT=2 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:26.115830 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1740cfc4-a97f-4c8b-b80c-900cd103795f req-cb0ab280-4d71-4b37-a876-1f68d217c287 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:26.116233 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-1740cfc4-a97f-4c8b-b80c-900cd103795f req-cb0ab280-4d71-4b37-a876-1f68d217c287 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:26.132379 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-1740cfc4-a97f-4c8b-b80c-900cd103795f req-cb0ab280-4d71-4b37-a876-1f68d217c287 service nova] Creating event network-changed:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:37:26.137857 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-1740cfc4-a97f-4c8b-b80c-900cd103795f req-cb0ab280-4d71-4b37-a876-1f68d217c287 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037156 Jul 20 19:37:26.139120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 527/1062] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:27.092229 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2027697109"}} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:27.092818 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:27.095170 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.103219 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.103677 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.104492 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.105486 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.110081 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=67 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.243371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.network.security_group_api [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Adding security group 92b72e5e-15c0-47aa-a2c1-6b2948749c94 to port b2f8849c-b018-4482-bb6c-be63601b75f0 Jul 20 19:37:27.583610 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-0d9bff0b-7193-43a0-ae98-45f76210d64a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action" status: 202 len: 0 microversion: 2.1 time: 0.495279 Jul 20 19:37:27.584946 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 536/1063] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:37:27 2022] POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:37:27.594120 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:27.594817 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:27.596987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.607136 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.608491 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.610376 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:27.611114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:27.626005 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.778887 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:27.786914 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-49f6bd30-9baf-4707-b05b-71ad1123549a tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1758 microversion: 2.1 time: 0.198169 Jul 20 19:37:27.787490 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 528/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:27 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:28.156033 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-07892e70-c805-4163-a14d-460dd289528f req-0e127c17-08ff-4e36-af93-f5f253ffcb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:28.164232 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-07892e70-c805-4163-a14d-460dd289528f req-0e127c17-08ff-4e36-af93-f5f253ffcb14 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:28.164727 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-07892e70-c805-4163-a14d-460dd289528f req-0e127c17-08ff-4e36-af93-f5f253ffcb14 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:28.175894 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-07892e70-c805-4163-a14d-460dd289528f req-0e127c17-08ff-4e36-af93-f5f253ffcb14 service nova] Creating event network-changed:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:37:28.182274 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-07892e70-c805-4163-a14d-460dd289528f req-0e127c17-08ff-4e36-af93-f5f253ffcb14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 Jul 20 19:37:28.183139 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 537/1065] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:37:50.106475 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:37:50.107408 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:50.109776 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:50.110414 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=5 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:50.115963 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.116430 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.117187 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.117612 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.195456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-9d9697eb-af9c-4d56-8875-56429dcbd403 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action" status: 202 len: 0 microversion: 2.1 time: 0.092672 Jul 20 19:37:50.196132 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 529/1066] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:37:50 2022] POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:37:50.205371 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:50.205923 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:50.208446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=3 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:50.209661 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=5 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:50.216438 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.216913 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.217860 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:50.218335 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:50.461327 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:50.469523 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e4159b8e-1ba8-4313-842a-f19a2d090ea7 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1750 microversion: 2.1 time: 0.268691 Jul 20 19:37:50.470100 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 538/1067] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:50 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1750 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:51.487834 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:51.488470 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:51.499329 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.499783 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.500582 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:51.501021 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:51.651242 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:51.659314 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-10746700-1083-4818-ad23-af301e0c1763 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.176074 Jul 20 19:37:51.659882 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 530/1068] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:51 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:52.677362 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:52.677903 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:52.684480 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.684933 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.685699 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:52.686133 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:52.829334 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:52.837410 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-385251fe-8bd4-4f68-a44f-0c9c1e9f6af5 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.164045 Jul 20 19:37:52.837986 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 539/1069] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:52 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:53.854972 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:53.855586 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:53.862090 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.862536 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:53.863299 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:53.863735 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:54.002676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:54.011071 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-88aae032-d4ff-4014-a828-7c1e4445bdd8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.159972 Jul 20 19:37:54.011638 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 531/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:53 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:55.028041 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:55.028680 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:55.035184 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.035640 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.036446 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:55.036892 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:55.176931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:55.185628 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-d0b9e386-7aec-42c5-b4a8-3838ed6e0ef4 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.161453 Jul 20 19:37:55.186192 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 540/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:55 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:56.203466 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:56.204057 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:56.210066 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.210512 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.211277 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:56.211713 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:56.350383 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:56.358752 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a18c0ee7-4732-4098-868f-390f7c8d7065 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.159284 Jul 20 19:37:56.359444 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 532/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:56 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:57.376559 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:57.377204 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:57.384541 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.384997 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.385768 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:57.386216 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:57.530861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:57.538908 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-e764fd37-83e7-4e03-bd4e-b87484d576b1 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.166249 Jul 20 19:37:57.539483 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 541/1073] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:57 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:58.556039 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:58.556688 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:58.563468 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.563917 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.564915 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:58.565390 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:58.709893 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:58.717720 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-32e4bd83-7641-4409-bef2-f6335985f875 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.165574 Jul 20 19:37:58.718286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 533/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:58 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:37:59.734879 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:37:59.735418 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:37:59.741907 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.742365 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.743137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:37:59.743584 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:37:59.886086 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:37:59.894269 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-bd42ac49-89d5-491a-bd98-30fa5a15db07 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.163436 Jul 20 19:37:59.894931 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 542/1075] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:37:59 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:00.911326 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:00.911943 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:00.918507 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.918956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:00.919712 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:00.920147 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:01.057845 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:01.065987 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-02a28c6e-1ead-4061-aed3-14538f86aac6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1755 microversion: 2.1 time: 0.158586 Jul 20 19:38:01.066546 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 534/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:00 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:02.084214 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:02.084782 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:02.091391 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:02.091842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:02.092639 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:02.093083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:02.240271 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:02.248177 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-80a473aa-8dff-4c45-a247-c877e7671d58 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1758 microversion: 2.1 time: 0.168466 Jul 20 19:38:02.248773 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 543/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:02 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:34.722477 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2027697109"}} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:34.723055 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:34.725569 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_api:SELECT=12 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:34.726216 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG dbcounter [-] [117769] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117769) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:34.731892 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.732353 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.733114 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:34.733545 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:34.861221 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.network.security_group_api [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Removing security group 92b72e5e-15c0-47aa-a2c1-6b2948749c94 from port b2f8849c-b018-4482-bb6c-be63601b75f0 Jul 20 19:38:35.186029 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-98876905-3c20-465e-a9d9-5810d3a02990 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action" status: 202 len: 0 microversion: 2.1 time: 0.467651 Jul 20 19:38:35.190158 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 535/1078] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jul 20 19:38:34 2022] POST /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:35.220531 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_api:SELECT=12 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:35.221481 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG dbcounter [-] [117768] Writing DB stats nova_cell1:SELECT=36 {{(pid=117768) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:35.302958 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [req-620a7851-84c7-4e93-b5e7-d41b589e608c req-45a2d534-3c4a-4ade-a008-67022314b353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:35.322066 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-620a7851-84c7-4e93-b5e7-d41b589e608c req-45a2d534-3c4a-4ade-a008-67022314b353 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:35.323608 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [req-620a7851-84c7-4e93-b5e7-d41b589e608c req-45a2d534-3c4a-4ade-a008-67022314b353 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:35.346372 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.compute.server_external_events [req-620a7851-84c7-4e93-b5e7-d41b589e608c req-45a2d534-3c4a-4ade-a008-67022314b353 service nova] Creating event network-changed:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:38:35.354946 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [req-620a7851-84c7-4e93-b5e7-d41b589e608c req-45a2d534-3c4a-4ade-a008-67022314b353 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159833 Jul 20 19:38:35.356487 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 544/1079] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:36.281910 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:36.282445 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:36.288416 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.288865 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.289676 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.290106 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.373037 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.objects.instance [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lazy-loading 'services' on Instance uuid eb13cf19-2969-417b-8972-f18a81c05359 {{(pid=117769) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 19:38:36.447327 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-5af830e1-1a96-40ed-bcfe-a213dfa5ff8b tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments/20015f23-a38d-482a-a10f-255dee245e70" status: 202 len: 0 microversion: 2.1 time: 0.169774 Jul 20 19:38:36.448218 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 536/1080] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:38:36 2022] DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments/20015f23-a38d-482a-a10f-255dee245e70 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:36.457061 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:36.458290 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:36.467330 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.468356 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.470155 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:36.470599 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:36.512658 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-16d2c2c9-2ff6-4a27-995b-22357cbe6dae tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059709 Jul 20 19:38:36.513255 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 545/1081] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:38:36 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:37.370620 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-47736307-59ad-4f30-a038-567a80a1fc6f req-35737d44-1835-4871-be5a-8a688ceaf2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:37.379306 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-47736307-59ad-4f30-a038-567a80a1fc6f req-35737d44-1835-4871-be5a-8a688ceaf2e7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.379739 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-47736307-59ad-4f30-a038-567a80a1fc6f req-35737d44-1835-4871-be5a-8a688ceaf2e7 service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.390653 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-47736307-59ad-4f30-a038-567a80a1fc6f req-35737d44-1835-4871-be5a-8a688ceaf2e7 service nova] Creating event network-changed:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:38:37.396065 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-47736307-59ad-4f30-a038-567a80a1fc6f req-35737d44-1835-4871-be5a-8a688ceaf2e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028805 Jul 20 19:38:37.396671 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 537/1082] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:37.525338 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:37.526276 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:37.533526 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.533904 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.534693 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.535137 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.570195 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-f68d0190-a581-4009-93a1-edbff7e7e754 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049559 Jul 20 19:38:37.570842 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 546/1083] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jul 20 19:38:37 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 19:38:37.581321 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:37.582017 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:37.589413 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.589869 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.590649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:37.591092 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:37.676654 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] HTTP exception thrown: Instance eb13cf19-2969-417b-8972-f18a81c05359 is not attached to volume 20015f23-a38d-482a-a10f-255dee245e70 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Request method failure captured: Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments/20015f23-a38d-482a-a10f-255dee245e70 HTTP/1.1 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FlJ99OAh-OZ0DFwUkt9GSdAlZ6q53C_ny1NGSuxSBdWRYLu5CtC_0wfcPO3OVhd-XaqGW-ZWVMWbyeQorYGx3l_mKnb-9GwJfNMaR-1RuMuz0bwlSZq0cD-LUNCSqvNX_noPePSrRY474LcK4LXSHw7fvHSQt5TA5LG-c2oSK2C7mQ Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 887ce1159e3c412b9cab436ecf76737c Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:38:37.679984 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/887ce1159e3c412b9cab436ecf76737c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/887ce1159e3c412b9cab436ecf76737c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_887ce1159e3c412b9cab436ecf76737c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/887ce1159e3c412b9cab436ecf76737c"}]}] Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 887ce1159e3c412b9cab436ecf76737c Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestMinimumBasicScenario-241747150-project Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 1d423c82039a41cd96a2c8b25c37647f Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestMinimumBasicScenario-241747150-project Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:38:37.683000 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance eb13cf19-2969-417b-8972-f18a81c05359 is not attached to volume 20015f23-a38d-482a-a10f-255dee245e70 Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'server_id': 'eb13cf19-2969-417b-8972-f18a81c05359', 'id': '20015f23-a38d-482a-a10f-255dee245e70'} Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20015f23-a38d-482a-a10f-255dee245e70. Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:37.683975 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb13cf19-2969-417b-8972-f18a81c05359 is not attached to volume 20015f23-a38d-482a-a10f-255dee245e70 Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb13cf19-2969-417b-8972-f18a81c05359 is not attached to volume 20015f23-a38d-482a-a10f-255dee245e70 Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:37.686020 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Returning 404 to user: Instance eb13cf19-2969-417b-8972-f18a81c05359 is not attached to volume 20015f23-a38d-482a-a10f-255dee245e70 {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:37.687285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-0ce01626-da34-411c-931a-ff3eeb8841ec tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments/20015f23-a38d-482a-a10f-255dee245e70" status: 404 len: 154 microversion: 2.1 time: 0.104547 Jul 20 19:38:37.687285 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 538/1084] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jul 20 19:38:37 2022] DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359/os-volume_attachments/20015f23-a38d-482a-a10f-255dee245e70 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:38.838920 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.839463 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:38.846060 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.846513 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.847280 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.847721 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.872496 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Going to try to terminate instance {{(pid=117768) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 19:38:38.947540 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-3fb2280e-3b0a-4ca0-b232-5b9b5b9be491 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 204 len: 0 microversion: 2.1 time: 0.112206 Jul 20 19:38:38.948233 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 547/1085] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jul 20 19:38:38 2022] DELETE /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 19:38:38.956811 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:38.957506 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:38.963956 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.964450 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:38.965214 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:38.965646 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:39.096850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.policy [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117769) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:39.104902 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-35f58ddc-f856-4804-866b-0c5deb771b77 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1553 microversion: 2.1 time: 0.152330 Jul 20 19:38:39.105467 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 539/1086] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:38 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:40.123517 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:40.124215 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:40.131605 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.132055 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.132861 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:40.133303 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:40.261576 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:40.269287 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-7ff74034-76f0-49b6-8c0d-7c3f9d31e6b6 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1553 microversion: 2.1 time: 0.150040 Jul 20 19:38:40.269865 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 548/1087] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:40 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:41.258289 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [req-e5c20b1c-0647-4a29-958b-4e5e035c63fe req-e9ae3681-cda6-4089-a59a-cf2eea16209e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13cf19-2969-417b-8972-f18a81c05359", "name": "network-vif-deleted", "tag": "b2f8849c-b018-4482-bb6c-be63601b75f0"}]} {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 19:38:41.267982 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-e5c20b1c-0647-4a29-958b-4e5e035c63fe req-e9ae3681-cda6-4089-a59a-cf2eea16209e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.268456 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [req-e5c20b1c-0647-4a29-958b-4e5e035c63fe req-e9ae3681-cda6-4089-a59a-cf2eea16209e service nova] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.280798 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.compute.server_external_events [req-e5c20b1c-0647-4a29-958b-4e5e035c63fe req-e9ae3681-cda6-4089-a59a-cf2eea16209e service nova] Creating event network-vif-deleted:b2f8849c-b018-4482-bb6c-be63601b75f0 for instance eb13cf19-2969-417b-8972-f18a81c05359 on hv-cinder-81914 Jul 20 19:38:41.286280 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [req-e5c20b1c-0647-4a29-958b-4e5e035c63fe req-e9ae3681-cda6-4089-a59a-cf2eea16209e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032001 Jul 20 19:38:41.286900 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 540/1088] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jul 20 19:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 19:38:41.288275 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:41.289191 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.compute.api [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117768) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:41.295789 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.296248 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.297083 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:41.297530 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG oslo_concurrency.lockutils [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117768) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:41.362056 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.policy [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d423c82039a41cd96a2c8b25c37647f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ce1159e3c412b9cab436ecf76737c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117768) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 19:38:41.369810 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-33a48c96-daf1-47b1-bcf3-802f0ad11498 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 200 len: 1343 microversion: 2.1 time: 0.087564 Jul 20 19:38:41.370384 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 549/1089] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:41 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 19:38:42.387457 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '>' {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:42.388154 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.compute.api [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] [instance: eb13cf19-2969-417b-8972-f18a81c05359] Fetching instance by UUID {{(pid=117769) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 19:38:42.394729 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:42.395179 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:42.396479 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 19:38:42.396919 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG oslo_concurrency.lockutils [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Lock "b072c1f4-5db9-429c-b0e6-4cf58b6cf08c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117769) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 19:38:42.409850 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.wsgi [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] HTTP exception thrown: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Request method failure captured: Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: request: GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 HTTP/1.1 Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept: application/json Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Accept-Encoding: identity Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Connection: close Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Length: 0 Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Content-Type: application/json Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Host: 10.222.0.43 Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Openstack-System-Scope: None Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: User-Agent: python-urllib3/1.26.9 Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Auth-Token: gAAAAABi2FlJ99OAh-OZ0DFwUkt9GSdAlZ6q53C_ny1NGSuxSBdWRYLu5CtC_0wfcPO3OVhd-XaqGW-ZWVMWbyeQorYGx3l_mKnb-9GwJfNMaR-1RuMuz0bwlSZq0cD-LUNCSqvNX_noPePSrRY474LcK4LXSHw7fvHSQt5TA5LG-c2oSK2C7mQ Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Id: None Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Domain-Name: None Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Identity-Status: Confirmed Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Is-Admin-Project: True Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Id: default Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Domain-Name: Default Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Id: 887ce1159e3c412b9cab436ecf76737c Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Project-Name: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Role: reader,member Jul 20 19:38:42.412099 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Roles: reader,member Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/887ce1159e3c412b9cab436ecf76737c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/887ce1159e3c412b9cab436ecf76737c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_887ce1159e3c412b9cab436ecf76737c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/887ce1159e3c412b9cab436ecf76737c"}]}] Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Id: 887ce1159e3c412b9cab436ecf76737c Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-Tenant-Name: tempest-TestMinimumBasicScenario-241747150 Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User: tempest-TestMinimumBasicScenario-241747150-project Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Id: default Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Domain-Name: Default Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Id: 1d423c82039a41cd96a2c8b25c37647f Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: X-User-Name: tempest-TestMinimumBasicScenario-241747150-project Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: method: > Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: exception: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. Jul 20 19:38:42.413876 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: action_args: {'id': 'eb13cf19-2969-417b-8972-f18a81c05359'} Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: {{(pid=117769) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 19:38:42.414864 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. Jul 20 19:38:42.416523 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: ERROR nova.api.openstack.wsgi Jul 20 19:38:42.417944 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: DEBUG nova.api.openstack.wsgi [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Returning 404 to user: Instance eb13cf19-2969-417b-8972-f18a81c05359 could not be found. {{(pid=117769) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 19:38:42.417944 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO nova.api.openstack.requestlog [None req-a538edb6-f866-4911-a364-7fd2236bd8d8 tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359" status: 404 len: 111 microversion: 2.1 time: 0.030755 Jul 20 19:38:42.417944 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: [pid: 117769|app: 0|req: 541/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jul 20 19:38:42 2022] GET /compute/v2.1/servers/eb13cf19-2969-417b-8972-f18a81c05359 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:42.422228 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: DEBUG nova.api.openstack.wsgi [None req-4c63f77d-09af-4ae5-a9f3-692206c2438c tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] Calling method '.version_select at 0x7f26c13efe50>' {{(pid=117768) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 19:38:42.440603 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO nova.api.openstack.requestlog [None req-4c63f77d-09af-4ae5-a9f3-692206c2438c tempest-TestMinimumBasicScenario-241747150 tempest-TestMinimumBasicScenario-241747150-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1937750479" status: 202 len: 0 microversion: 2.1 time: 0.022096 Jul 20 19:38:42.441166 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: [pid: 117768|app: 0|req: 550/1091] 10.222.0.43 () {58 vars in 1271 bytes} [Wed Jul 20 19:38:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1937750479 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 19:38:59.128679 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:38:59.129286 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Wed Jul 20 19:38:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:39:05.871649 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:39:05.872346 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Wed Jul 20 19:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:40:45.103482 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:40:45.104124 dv-cinder-819149-14-iscsi devstack@n-api.service[117768]: Wed Jul 20 19:40:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:19.138639 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:42:19.139275 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Wed Jul 20 19:42:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 19:42:25.880436 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 19:42:25.881095 dv-cinder-819149-14-iscsi devstack@n-api.service[117769]: Wed Jul 20 19:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!